00000001:02000400:3.0F:1788624937.818475:0:3293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788624956.183287:0:3512:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788624957.924871:0:3556:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1203 MB/s 00000001:01000000:1.0F:1788624958.174673:0:3556:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1003 MB/s 00000001:01000000:2.0:1788624958.424607:0:3556:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6159 MB/s 00000020:02000000:2.0:1788624959.290358:0:3604:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g69c2166 00000400:02000000:0.0:1788624960.100240:0:3619:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.114@tcp [8/256/0/180] 00008000:02000000:0.0:1788624964.309648:0:3769:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788625028.611321:0:5738:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788625042.197416:0:6487:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788625042.197424:0:6487:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788625042.197425:0:6487:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788625042.200788:0:6487:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005528947f 00000080:02000400:3.0:1788625042.200808:0:6487:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788625042.215927:0:6487:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788625042.215942:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788625042.216048:0:6487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004d7a69d0) 00000020:00000080:3.0:1788625042.216073:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788625042.337731:0:6487:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788625042.337820:0:6487:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1788625042.420079:0:6487:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788625042.420502:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788625042.420512:0:6487:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788625042.420546:0:6487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a79dcc 00000020:01000004:1.0:1788625042.420553:0:6487:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788625042.420558:0:6487:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788625042.420562:0:6487:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005528947f from MGS 00000020:01000004:1.0:1788625042.420567:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788625042.420594:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000d5acb58f) 00000020:00000080:1.0:1788625042.420604:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788625042.420730:0:6487:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005528947f from MGS, refs=2 00080000:01000000:1.0:1788625042.420737:0:6487:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788625042.420742:0:6487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a79dda 00000100:00100000:1.0:1788625042.420832:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788625042.420968:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788625042.420974:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788625042.430851:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788625042.430866:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788625042.437173:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625042.437355:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788625042.437362:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788625042.448181:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788625042.448198:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788625042.449709:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788625042.449722:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788625042.454735:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625042.454744:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625042.454746:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625042.455242:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625042.455245:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625042.455246:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625042.455794:0:6487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788625042.459897:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788625042.710912:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1501 MB/s 00000001:01000000:3.0:1788625042.960636:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2643 MB/s 00000001:01000000:1.0:1788625043.210677:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1079 MB/s 00000001:01000000:2.0:1788625043.462667:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1027 MB/s 00010000:00010000:3.0:1788625043.467830:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788625043.500415:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1788625043.521729:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788625043.523957:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788625043.524077:0:6487:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788625043.524425:0:6487:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788625043.524783:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788625043.524809:0:6487:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788625043.526821:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625043.527028:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788625043.527036:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788625043.536345:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788625043.536366:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788625043.542758:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788625043.542780:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788625043.545421:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788625043.545447:0:6487:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.114@tcp' 00000020:01000004:0.0:1788625043.545449:0:6487:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788625043.545540:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.114@tcp (typ=mgc) 00000020:00000080:0.0:1788625043.545561:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.114@tcp (000000002bd7754c) 00000020:00000080:0.0:1788625043.545578:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788625043.545719:0:6487:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000025634c95@MGC192.168.204.114@tcp: add connection 192.168.204.114@tcp at head 00010000:00010000:0.0:1788625043.545894:0:6487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.114@tcp-0 is initialized 00000040:01000000:0.0:1788625043.545901:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.114@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788625043.546305:0:6507:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788625043.553275:0:6508:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788625043.553332:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.114@tcp (uuid 6544f02a-cd81-4e03-84c5-408bee21ab7a) 00000020:00000080:0.0:1788625043.553369:0:6487:0:(genops.c:1385:class_connect()) connect: client 6544f02a-cd81-4e03-84c5-408bee21ab7a, cookie 0x2d2e3b3f34a79de8 00000100:00080000:0.0:1788625043.553381:0:6487:0:(import.c:545:import_select_connection()) MGC192.168.204.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788625043.553387:0:6487:0:(import.c:665:import_select_connection()) MGC192.168.204.114@tcp: import 0000000025634c95 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625043.553436:0:6487:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009c1282dc x1875509206057088/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625043.553564:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009c1282dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6544f02a-cd81-4e03-84c5-408bee21ab7a:3634:1875509206057088:0@lo:250: 00000100:00100000:0.0:1788625043.553663:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788625043.555333:0:6487:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6544f02a-cd81-4e03-84c5-408bee21ab7a->MGS 00000020:01000004:1.0:1788625043.555370:0:6487:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788625043.555397:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788625043.555410:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000be3ff3c1) 00000020:00000080:1.0:1788625043.555432:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788625043.574577:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206057088 00000100:00100000:3.0:1788625043.574593:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206057088 00000100:00100000:3.0:1788625043.574657:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625043.574665:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cbddb65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3634:x1875509206057088:12345-0@lo:250: 00010000:00080000:3.0:1788625043.574695:0:6503:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6544f02a-cd81-4e03-84c5-408bee21ab7a@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:3.0:1788625043.574728:0:6503:0:(genops.c:1385:class_connect()) connect: client 6544f02a-cd81-4e03-84c5-408bee21ab7a, cookie 0x2d2e3b3f34a79df6 00000100:00080000:3.0:1788625043.575073:0:6503:0:(import.c:65:import_set_state_nolock()) 00000000cd0c66ac : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625043.575251:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cbddb65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:3634:x1875509206057088:12345-0@lo:250: Request processed in 585us (21588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625043.575275:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625043.577005:0:3634:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788625043.577020:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.114@tcp: connect to target with instance 0 00000100:00080000:0.0:1788625043.577039:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788625043.577051:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788625043.577055:0:3634:0:(import.c:65:import_set_state_nolock()) 0000000025634c95 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788625043.577059:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788625043.577071:0:3634:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788625043.577077:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009c1282dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6544f02a-cd81-4e03-84c5-408bee21ab7a:3634:1875509206057088:0@lo:250: 00000100:00100000:0.0:1788625043.589806:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625043.590115:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788625043.590178:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788625043.607492:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788625043.607550:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788625043.612270:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788625043.612294:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788625043.617563:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788625043.617831:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788625043.617837:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788625043.620042:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788625043.620056:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788625043.652948:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788625043.653169:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788625043.653176:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788625043.657382:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788625043.657397:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788625043.658670:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625043.658887:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788625043.658893:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788625043.664320:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788625043.668315:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788625043.669716:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625043.670147:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788625043.670154:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788625043.674285:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788625043.674305:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788625043.677086:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625043.677559:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788625043.677566:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788625043.680732:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788625043.680746:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788625043.758427:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788625043.758795:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788625043.758802:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788625043.767115:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788625043.767138:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788625043.771561:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788625043.771585:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788625043.773434:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788625043.773465:0:6487:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788625043.773472:0:6487:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788625043.773626:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788625043.773663:0:6487:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.114@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788625043.773667:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788625043.773669:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788625043.773670:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625043.773671:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625043.773672:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625043.773673:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625043.773674:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788625043.773675:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788625043.773677:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788625043.773678:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788625043.773679:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625043.773680:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788625043.773683:0:6487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788625043.773685:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788625043.773687:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788625043.773688:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625043.773689:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625043.773690:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625043.773691:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625043.773692:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788625043.773692:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788625043.773693:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788625043.773695:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788625043.773696:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625043.773697:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788625043.773731:0:6487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788625043.773748:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000653eb98f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206057216:0@lo:253: 00000100:00100000:3.0:1788625043.773837:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625043.773902:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013dfe49d going to sleep for 11 seconds 00000100:00100000:2.0:1788625043.774724:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206057216 00000100:00100000:2.0:1788625043.774735:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206057216 00000100:00100000:2.0:1788625043.774800:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625043.774809:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2ef4f85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:6487:x1875509206057216:12345-0@lo:253: 20000000:01000000:2.0:1788625043.774858:0:6506:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788625043.774861:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788625043.775229:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788625043.775292:0:6506:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788625043.775626:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625043.779066:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788625043.781128:0:6506:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788625043.781133:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788625043.781139:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788625043.781142:0:6506:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788625043.781174:0:6506:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788625043.781388:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625043.785359:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788625043.785397:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788625043.785432:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788625043.785449:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788625043.785463:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788625043.785561:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788625043.785585:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788625043.785600:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788625043.785604:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788625043.785625:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788625043.785630:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788625043.785640:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788625043.785651:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788625043.785678:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788625043.785682:0:6506:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788625043.785688:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625043.785796:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788625043.785805:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788625043.785817:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788625043.785828:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788625043.785842:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788625043.785850:0:6506:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788625043.785874:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788625043.785882:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788625043.785896:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788625043.785926:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788625043.785943:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788625043.785952:0:6506:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788625043.785975:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788625043.785983:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788625043.786006:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788625043.786022:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788625043.786073:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788625043.786092:0:6506:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788625043.786098:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788625043.795733:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788625043.796002:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788625043.796030:0:6506:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.114@tcp for mdt 20000000:01000000:0.0:1788625043.796032:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.114@tcp (null) (null) (null) 00000040:00080000:0.0:1788625043.796048:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788625043.796054:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788625043.796067:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788625043.796073:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.114@tcp (null) (null) 00000040:00080000:0.0:1788625043.796086:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788625043.796094:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788625043.796106:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788625043.796137:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788625043.796170:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788625043.796173:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788625043.796176:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788625043.796229:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788625043.796232:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788625043.797002:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788625043.797164:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788625043.797188:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788625043.797204:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788625043.797214:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788625043.797216:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788625043.801120:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788625043.801378:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788625043.801408:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788625043.801426:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1788625043.801436:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788625043.801439:0:6506:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788625043.801444:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788625043.801446:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788625043.801451:0:6506:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788625043.801457:0:6506:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788625043.805154:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788625043.805352:0:6506:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788625043.813894:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788625043.813934:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788625043.813949:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788625043.813967:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788625043.813988:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79dfd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625043.814003:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79dfd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625043.814013:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79dfd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625043.814019:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79dfd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625043.814040:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79dfd lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625043.814046:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79dfd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625043.814050:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002c073537 already unused, calling callback (0000000055fa61c0) 00010000:00010000:0.0:1788625043.814054:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79dfd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625043.814060:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79dfd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625043.814072:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79dfd lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625043.814079:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79dfd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625043.814085:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79dfd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788625043.814104:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788625043.837306:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2ef4f85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:6487:x1875509206057216:12345-0@lo:253: Request processed in 62490us (63473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625043.837321:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625043.837447:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000653eb98f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206057216:0@lo:253: 10000000:01000000:3.0:1788625043.837465:0:6487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788625043.837468:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788625043.837469:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788625043.837471:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625043.837472:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788625043.837474:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625043.837475:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625043.837476:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788625043.837477:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788625043.837479:0:6487:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788625043.837480:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625043.837482:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788625043.837500:0:6487:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005528947f from lustre-MDT0000 10000000:01000000:3.0:1788625043.837559:0:6487:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788625043.837562:0:6487:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788625043.837566:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99885ecd99c0 10000000:01000000:3.0:1788625043.837570:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788625043.837579:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99885ecd99c0 from 1 10000000:01000000:3.0:1788625043.837581:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788625043.837650:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 00000000d46bc6c5/0x2d2e3b3f34a79e04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625043.837661:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 00000000d46bc6c5/0x2d2e3b3f34a79e04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625043.837669:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 00000000d46bc6c5/0x2d2e3b3f34a79e04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625043.837687:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000653eb98f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206057344:0@lo:101: 00000100:00100000:3.0:1788625043.837734:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625043.837793:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ee882ea going to sleep for 11 seconds 00000100:00100000:0.0:1788625043.838194:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206057344 00000100:00100000:0.0:1788625043.838202:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206057344 00000100:00100000:0.0:1788625043.838248:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625043.838256:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064c3b085 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:6487:x1875509206057344:12345-0@lo:101: 00010000:00010000:0.0:1788625043.838268:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625043.838282:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79e0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79e04 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625043.838314:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79e0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e04 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625043.838324:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79e0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e04 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625043.838333:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002c073537, rc 0) 00000100:00100000:0.0:1788625043.838379:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064c3b085 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:6487:x1875509206057344:12345-0@lo:101: Request processed in 125us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625043.838385:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788625043.838465:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000653eb98f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206057344:0@lo:101: 00010000:00010000:1.0:1788625043.838477:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 00000000d46bc6c5/0x2d2e3b3f34a79e04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e0b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625043.838484:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 00000000d46bc6c5/0x2d2e3b3f34a79e04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79e0b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625043.838598:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206057472:0@lo:501: 00000100:00100000:1.0:1788625043.838651:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625043.838676:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdf9c121 going to sleep for 11 seconds 00000100:00100000:2.0:1788625043.838743:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206057472 00000100:00100000:2.0:1788625043.838748:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206057472 00000100:00100000:2.0:1788625043.838773:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625043.838779:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e733152e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:6487:x1875509206057472:12345-0@lo:501: 00000100:00100000:2.0:1788625043.838855:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e733152e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:6487:x1875509206057472:12345-0@lo:501: Request processed in 78us (205us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625043.838862:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625043.838926:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206057472:0@lo:501: 10000000:01000000:1.0:1788625043.838954:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788625043.838974:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 00000000d46bc6c5/0x2d2e3b3f34a79e04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e0b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625043.838982:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 00000000d46bc6c5/0x2d2e3b3f34a79e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e0b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625043.838997:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998852348000 10000000:01000000:1.0:1788625043.839001:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788625043.839004:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff998852348000 10000000:01000000:1.0:1788625043.839007:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788625043.839009:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff998852348000 from 1 10000000:01000000:1.0:1788625043.839011:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788625043.839029:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 0000000017941658/0x2d2e3b3f34a79e12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625043.839035:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 0000000017941658/0x2d2e3b3f34a79e12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625043.839042:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 0000000017941658/0x2d2e3b3f34a79e12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625043.839052:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206057600:0@lo:101: 00000100:00100000:1.0:1788625043.839077:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625043.839094:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdf9c121 going to sleep for 11 seconds 00000100:00100000:2.0:1788625043.839198:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206057600 00000100:00100000:2.0:1788625043.839203:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206057600 00000100:00100000:2.0:1788625043.839220:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788625043.839225:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bc3afb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:6487:x1875509206057600:12345-0@lo:101: 00010000:00010000:2.0:1788625043.839232:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625043.839242:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e85a6d77/0x2d2e3b3f34a79e19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79e12 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625043.839255:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e85a6d77/0x2d2e3b3f34a79e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e12 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625043.839276:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e85a6d77/0x2d2e3b3f34a79e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e12 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625043.839284:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e85a6d77, rc 0) 00000100:00100000:2.0:1788625043.839317:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bc3afb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+7:6487:x1875509206057600:12345-0@lo:101: Request processed in 92us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625043.839322:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788625043.839385:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206057600:0@lo:101: 00010000:00010000:1.0:1788625043.839395:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 0000000017941658/0x2d2e3b3f34a79e12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e19 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625043.839401:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 0000000017941658/0x2d2e3b3f34a79e12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79e19 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625043.839411:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788625043.839423:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 0000000017941658/0x2d2e3b3f34a79e12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e19 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625043.839439:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 0000000017941658/0x2d2e3b3f34a79e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e19 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625043.839445:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788625043.839447:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788625043.839451:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff998852348000 10000000:01000000:1.0:1788625043.839453:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788625043.839455:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788625043.839457:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788625043.839468:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79e20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625043.839474:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79e20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625043.839480:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79e20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625043.839489:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206057728:0@lo:101: 00000100:00100000:1.0:1788625043.839512:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625043.839552:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdf9c121 going to sleep for 11 seconds 00000100:00100000:2.0:1788625043.839673:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206057728 00000100:00100000:2.0:1788625043.839678:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206057728 00000100:00100000:2.0:1788625043.839695:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788625043.839700:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0f13c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+7:6487:x1875509206057728:12345-0@lo:101: 00010000:00010000:2.0:1788625043.839706:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625043.839712:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a376f74d/0x2d2e3b3f34a79e27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79e20 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625043.839723:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a376f74d/0x2d2e3b3f34a79e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e20 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625043.839730:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a376f74d/0x2d2e3b3f34a79e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e20 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625043.839735:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a376f74d, rc 0) 00000100:00100000:2.0:1788625043.839758:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0f13c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+8:6487:x1875509206057728:12345-0@lo:101: Request processed in 58us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625043.839764:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788625043.839829:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206057728:0@lo:101: 00010000:00010000:1.0:1788625043.839838:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79e20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e27 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625043.839845:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79e20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79e27 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625043.839894:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206057856:0@lo:501: 00000100:00100000:1.0:1788625043.839917:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625043.839943:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdf9c121 going to sleep for 11 seconds 00000100:00100000:2.0:1788625043.839989:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206057856 00000100:00100000:2.0:1788625043.839993:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206057856 00000100:00100000:2.0:1788625043.840011:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788625043.840022:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008add7b27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+8:6487:x1875509206057856:12345-0@lo:501: 00000100:00100000:2.0:1788625043.840116:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008add7b27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+9:6487:x1875509206057856:12345-0@lo:501: Request processed in 95us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625043.840123:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625043.840188:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206057856:0@lo:501: 00000100:00100000:1.0:1788625043.840211:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206057984:0@lo:503: 00000100:00100000:1.0:1788625043.840246:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625043.840266:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdf9c121 going to sleep for 11 seconds 00000100:00100000:0.0:1788625043.840328:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206057984 00000100:00100000:0.0:1788625043.840333:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206057984 00000100:00100000:0.0:1788625043.840351:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788625043.840356:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000103e60c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+9:6487:x1875509206057984:12345-0@lo:503: 00000100:00100000:0.0:1788625043.840437:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000103e60c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+9:6487:x1875509206057984:12345-0@lo:503: Request processed in 80us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625043.840444:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625043.840546:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206057984:0@lo:503: 00000100:00100000:1.0:1788625043.841123:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:6533:1875509206058112:0@lo:502: 00000100:00100000:1.0:1788625043.841161:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625043.841192:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025fa09be going to sleep for 11 seconds 00000100:00100000:0.0:1788625043.841242:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206058112 00000100:00100000:0.0:1788625043.841247:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206058112 00000100:00100000:0.0:1788625043.841279:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625043.841286:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001dd8b61d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+9:6533:x1875509206058112:12345-0@lo:502: 00000100:00100000:0.0:1788625043.841372:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001dd8b61d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+9:6533:x1875509206058112:12345-0@lo:502: Request processed in 87us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625043.841379:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788625043.841482:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:6533:1875509206058112:0@lo:502: 00000020:01000000:1.0:1788625043.841504:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625043.841540:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625043.841543:0:6533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788625043.841549:0:6533:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788625043.841552:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788625043.841698:0:6533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ead3529d) 00000020:00000080:1.0:1788625043.841724:0:6533:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788625043.841732:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788625043.841800:0:6533:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788625043.841807:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a79e35 00000020:00000080:1.0:1788625043.842037:0:6533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788625043.842041:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625043.842045:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625043.842052:0:6533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788625043.842055:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625043.842059:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625043.842060:0:6533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788625043.842063:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788625043.842069:0:6533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000006b33c29e) 00000020:00000080:1.0:1788625043.842079:0:6533:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788625043.842083:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788625043.842085:0:6533:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788625043.842087:0:6533:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788625043.842093:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788625043.842140:0:6533:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005528947f from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788625043.842159:0:6533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000038e99e61) 00000020:00000080:1.0:1788625043.842168:0:6533:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788625043.842231:0:6533:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788625043.842237:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a79e4a 00000020:00000080:1.0:1788625043.842325:0:6533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788625043.842330:0:6533:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788625043.842334:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2d2e3b3f34a79e51 00080000:01000000:1.0:1788625043.842339:0:6533:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788625043.842342:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a79e58 00080000:10000000:1.0:1788625043.845008:0:6533:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788625043.845203:0:6533:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788625043.855706:0:6533:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788625044.011041:0:6533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788625044.011766:0:6533:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788625044.019404:0:6533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788625044.025384:0:6533:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788625044.042590:0:6533:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001caa7807) 00000020:00000080:2.0:1788625044.042630:0:6533:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788625044.042714:0:6533:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788625044.042724:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a79e66 00000020:00000080:3.0:1788625044.046629:0:6533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788625044.049246:0:6533:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1788625044.065695:0:6533:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1788625044.073446:0:6533:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1788625044.086507:0:6533:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1788625044.088951:0:6533:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1788625044.091117:0:6533:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1788625044.103148:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2d2e3b3f34a79e6d 00000020:00000080:1.0:1788625044.103709:0:6533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788625044.103720:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625044.103727:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625044.103729:0:6533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788625044.103732:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625044.103736:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625044.103737:0:6533:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788625044.103740:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788625044.103742:0:6533:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788625044.103751:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625044.103753:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625044.103755:0:6533:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788625044.103757:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625044.103762:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625044.103764:0:6533:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788625044.103768:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788625044.103812:0:6533:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788625044.103877:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:6533:1875509206058240:0@lo:502: 00000100:00100000:1.0:1788625044.103966:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625044.104029:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fc8e2d5 going to sleep for 11 seconds 00000100:00100000:3.0:1788625044.104113:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206058240 00000100:00100000:3.0:1788625044.104121:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206058240 00000100:00100000:3.0:1788625044.104182:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788625044.104192:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0e507d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+9:6533:x1875509206058240:12345-0@lo:502: 00000100:00100000:3.0:1788625044.104318:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0e507d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+9:6533:x1875509206058240:12345-0@lo:502: Request processed in 127us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625044.104326:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625044.104644:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:6533:1875509206058240:0@lo:502: 00000020:01000000:1.0:1788625044.104686:0:6533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625044.104691:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625044.104693:0:6533:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788625044.104696:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788625044.104919:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788625044.104941:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788625044.104962:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79e20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e27 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625044.104972:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e27 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625044.104981:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998852348000 from 1 10000000:01000000:2.0:1788625044.104984:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788625044.105019:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79e74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625044.105027:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79e74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625044.105036:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79e74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625044.105061:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a3d96572 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206058368:0@lo:101: 00000100:00100000:2.0:1788625044.105094:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625044.105116:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aa810be4 going to sleep for 11 seconds 00000100:00100000:3.0:1788625044.105422:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206058368 00000100:00100000:3.0:1788625044.105428:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206058368 00000100:00100000:3.0:1788625044.105457:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788625044.105464:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000defcd8bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+9:6487:x1875509206058368:12345-0@lo:101: 00010000:00010000:3.0:1788625044.105476:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625044.105491:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000098a1b88c/0x2d2e3b3f34a79e7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79e74 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.105513:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098a1b88c/0x2d2e3b3f34a79e7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e74 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.105557:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000098a1b88c/0x2d2e3b3f34a79e7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e74 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.105565:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000098a1b88c, rc 0) 00000100:00100000:3.0:1788625044.105617:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000defcd8bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+10:6487:x1875509206058368:12345-0@lo:101: Request processed in 153us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625044.105623:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625044.106484:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a3d96572 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206058368:0@lo:101: 00010000:00010000:2.0:1788625044.106501:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79e74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e7b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625044.106511:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79e74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79e7b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625044.107116:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a3d96572 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206058496:0@lo:256: 00000100:00100000:2.0:1788625044.107174:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625044.107205:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aa810be4 going to sleep for 11 seconds 00000100:00100000:1.0:1788625044.107780:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206058496 00000100:00100000:1.0:1788625044.107787:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206058496 00000100:00100000:1.0:1788625044.107827:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788625044.107834:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ff39b7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+10:6487:x1875509206058496:12345-0@lo:256: 20000000:01000000:1.0:1788625044.107852:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788625044.107857:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788625044.107935:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ff39b7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+10:6487:x1875509206058496:12345-0@lo:256: Request processed in 102us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625044.107942:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625044.108038:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a3d96572 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206058496:0@lo:256: 10000000:01000000:0.0:1788625044.108657:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788625044.108683:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79e74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e7b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.108693:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79e74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e7b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625044.108703:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998852348000 from 1 10000000:01000000:0.0:1788625044.108706:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788625044.108734:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 00000000f1facfcb/0x2d2e3b3f34a79e82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.108742:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 00000000f1facfcb/0x2d2e3b3f34a79e82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.108750:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 00000000f1facfcb/0x2d2e3b3f34a79e82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625044.108766:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009c1282dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206058624:0@lo:101: 00000100:00100000:0.0:1788625044.108803:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625044.108829:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de582f62 going to sleep for 11 seconds 00000100:00100000:3.0:1788625044.109447:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206058624 00000100:00100000:3.0:1788625044.109456:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206058624 00000100:00100000:3.0:1788625044.109495:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788625044.109503:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004188c562 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+10:6487:x1875509206058624:12345-0@lo:101: 00010000:00010000:3.0:1788625044.109542:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625044.109563:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000290d483a/0x2d2e3b3f34a79e89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79e82 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.109591:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000290d483a/0x2d2e3b3f34a79e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e82 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.109611:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000290d483a/0x2d2e3b3f34a79e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e82 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.109619:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000290d483a, rc 0) 00000100:00100000:3.0:1788625044.109671:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004188c562 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:6487:x1875509206058624:12345-0@lo:101: Request processed in 169us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625044.109677:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625044.111369:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009c1282dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206058624:0@lo:101: 00010000:00010000:0.0:1788625044.111393:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 00000000f1facfcb/0x2d2e3b3f34a79e82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e89 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.111405:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 00000000f1facfcb/0x2d2e3b3f34a79e82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79e89 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625044.111498:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009c1282dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206058752:0@lo:501: 00000100:00100000:0.0:1788625044.111577:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625044.111623:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de582f62 going to sleep for 11 seconds 00000100:00100000:1.0:1788625044.111832:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206058752 00000100:00100000:1.0:1788625044.111839:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206058752 00000100:00100000:1.0:1788625044.111879:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788625044.111886:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e05441df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:6487:x1875509206058752:12345-0@lo:501: 00000100:00100000:1.0:1788625044.112047:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e05441df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:6487:x1875509206058752:12345-0@lo:501: Request processed in 162us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625044.112055:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788625044.117927:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009c1282dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206058752:0@lo:501: 00000100:00100000:0.0:1788625044.118002:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009c1282dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206058880:0@lo:503: 00000100:00100000:0.0:1788625044.118084:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625044.118130:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de582f62 going to sleep for 11 seconds 00000100:00100000:1.0:1788625044.119060:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206058880 00000100:00100000:1.0:1788625044.119069:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206058880 00000100:00100000:1.0:1788625044.119125:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788625044.119135:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000149e24ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:6487:x1875509206058880:12345-0@lo:503: 00000040:00080000:1.0:1788625044.119203:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788625044.119274:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000149e24ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:6487:x1875509206058880:12345-0@lo:503: Request processed in 140us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625044.119282:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788625044.119660:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009c1282dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206058880:0@lo:503: 00000040:00080000:3.0:1788625044.120646:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788625044.120954:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788625044.120975:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788625044.120990:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 00000000f1facfcb/0x2d2e3b3f34a79e82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e89 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.121001:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 00000000f1facfcb/0x2d2e3b3f34a79e82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e89 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625044.121045:0:6487:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788625044.121048:0:6487:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998852348000 10000000:01000000:0.0:1788625044.121051:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998852348000 10000000:01000000:0.0:1788625044.121054:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788625044.121060:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998852348000 from 1 10000000:01000000:0.0:1788625044.121063:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788625044.121092:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79e90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.121101:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79e90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.121117:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79e90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625044.121138:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009c1282dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206059008:0@lo:101: 00000100:00100000:0.0:1788625044.121197:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625044.121239:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ac83523 going to sleep for 11 seconds 00000100:00100000:2.0:1788625044.121285:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206059008 00000100:00100000:2.0:1788625044.121291:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206059008 00000100:00100000:2.0:1788625044.121331:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788625044.121339:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000442ad927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:6487:x1875509206059008:12345-0@lo:101: 00010000:00010000:2.0:1788625044.121349:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625044.121362:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79e97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79e90 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625044.121383:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e90 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625044.121395:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e90 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625044.121418:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000047900784, rc 0) 00000100:00100000:2.0:1788625044.121457:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000442ad927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:6487:x1875509206059008:12345-0@lo:101: Request processed in 119us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625044.121463:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625044.121807:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009c1282dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206059008:0@lo:101: 00010000:00010000:0.0:1788625044.121820:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79e90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e97 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.121829:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79e90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79e97 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625044.121890:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009c1282dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206059136:0@lo:501: 00000100:00100000:0.0:1788625044.121917:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625044.121941:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ac83523 going to sleep for 11 seconds 00000100:00100000:2.0:1788625044.121994:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206059136 00000100:00100000:2.0:1788625044.121999:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206059136 00000100:00100000:2.0:1788625044.122029:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788625044.122034:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055b1ef53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:6487:x1875509206059136:12345-0@lo:501: 00000100:00100000:2.0:1788625044.122154:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055b1ef53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:6487:x1875509206059136:12345-0@lo:501: Request processed in 120us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625044.122172:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788625044.122276:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009c1282dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206059136:0@lo:501: 00000100:00100000:1.0:1788625044.122304:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206059264:0@lo:503: 00000100:00100000:1.0:1788625044.122339:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625044.122358:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000008025a370 going to sleep for 11 seconds 00000100:00100000:2.0:1788625044.122398:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206059264 00000100:00100000:2.0:1788625044.122402:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206059264 00000100:00100000:2.0:1788625044.122418:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788625044.122423:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf469ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:6487:x1875509206059264:12345-0@lo:503: 00000100:00100000:2.0:1788625044.122501:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf469ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:6487:x1875509206059264:12345-0@lo:503: Request processed in 78us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625044.122507:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788625044.122649:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206059264:0@lo:503: 00000100:00100000:3.0:1788625044.123477:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb441bb0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:6538:1875509206059392:0@lo:502: 00000100:00100000:3.0:1788625044.123551:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625044.123588:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set 00000000900b622b going to sleep for 11 seconds 00000100:00100000:2.0:1788625044.123648:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206059392 00000100:00100000:2.0:1788625044.123653:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206059392 00000100:00100000:2.0:1788625044.123693:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788625044.123700:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5a7a292 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:6538:x1875509206059392:12345-0@lo:502: 00000100:00100000:2.0:1788625044.123801:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5a7a292 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:6538:x1875509206059392:12345-0@lo:502: Request processed in 102us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625044.123808:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788625044.123940:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb441bb0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:6538:1875509206059392:0@lo:502: 00000020:01000004:0.0:1788625044.123991:0:6538:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788625044.124005:0:6538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000fd33ddce) 00000020:00000080:0.0:1788625044.124024:0:6538:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788625044.124098:0:6538:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005528947f from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788625044.124102:0:6538:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005528947f from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788625044.124104:0:6538:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005528947f 4 00010000:00080000:0.0:1788625044.124128:0:6538:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000027b7bf2e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.114@tcp at head 00010000:00010000:0.0:1788625044.128546:0:6538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788625044.129937:0:6538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788625044.129995:0:6538:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788625044.130010:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2d2e3b3f34a79ea5 00000100:00080000:0.0:1788625044.130021:0:6538:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788625044.130026:0:6538:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000027b7bf2e using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625044.130061:0:6538:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dc45ff74 x1875509206059520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625044.130089:0:6538:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788625044.130538:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc45ff74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206059520:0@lo:38: 00000100:00100000:3.0:1788625044.130622:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625044.138076:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062dbf826 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:6538:1875509206059648:0@lo:502: 00000100:00100000:2.0:1788625044.138238:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625044.138290:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c41e8ad7 going to sleep for 11 seconds 00000100:00100000:1.0:1788625044.140343:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206059648 00000100:00100000:1.0:1788625044.140356:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206059648 00000100:00100000:1.0:1788625044.140412:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788625044.140421:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc1cd424 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:6538:x1875509206059648:12345-0@lo:502: 00000100:00100000:1.0:1788625044.140621:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc1cd424 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:6538:x1875509206059648:12345-0@lo:502: Request processed in 200us (2383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625044.140629:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788625044.140850:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206059520 00000100:00100000:0.0:1788625044.140855:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206059520 00000100:00100000:0.0:1788625044.140885:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625044.140890:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5a69b7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875509206059520:12345-0@lo:38: 00000100:00100000:0.0:1788625044.140945:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5a69b7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875509206059520:12345-0@lo:38: Request processed in 55us (10324us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788625044.140952:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625044.140992:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788625044.140999:0:3634:0:(import.c:65:import_set_state_nolock()) 0000000027b7bf2e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625044.141003:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788625044.141006:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc45ff74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206059520:0@lo:38: 00000100:00100000:2.0:1788625044.141853:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062dbf826 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:6538:1875509206059648:0@lo:502: 00000040:00080000:2.0:1788625044.141889:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788625044.142855:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788625044.142884:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788625044.142906:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79e90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e97 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.142919:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e97 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788625044.142983:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788625044.142985:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625044.142991:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625044.142992:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625044.142993:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625044.142995:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625044.142996:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625044.142997:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625044.142998:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788625044.143000:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788625044.143002:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625044.143003:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788625044.143006:0:6487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788625044.143009:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788625044.143010:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625044.143010:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625044.143011:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625044.143012:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625044.143013:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625044.143014:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625044.143015:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625044.143016:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788625044.143016:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788625044.143017:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625044.143018:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788625044.143042:0:6487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788625044.143059:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc45ff74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206059776:0@lo:253: 00000100:00100000:0.0:1788625044.143130:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625044.143186:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de582f62 going to sleep for 11 seconds 00000100:00100000:3.0:1788625044.143427:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206059776 00000100:00100000:3.0:1788625044.143441:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206059776 00000100:00100000:3.0:1788625044.143492:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788625044.143501:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c70b41f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:6487:x1875509206059776:12345-0@lo:253: 20000000:01000000:3.0:1788625044.145138:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788625044.145159:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788625044.152985:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788625044.153006:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788625044.153327:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c70b41f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:6487:x1875509206059776:12345-0@lo:253: Request processed in 9822us (10193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625044.153342:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625044.153447:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc45ff74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:6487:1875509206059776:0@lo:253: 10000000:01000000:1.0:1788625044.153463:0:6487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788625044.153477:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788625044.153480:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788625044.153481:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625044.153483:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625044.153484:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625044.153485:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625044.153487:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788625044.153488:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788625044.153489:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788625044.153491:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788625044.153492:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625044.153493:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788625044.153511:0:6487:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788625044.153614:0:6527:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788625044.153619:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788625044.153637:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bc716b5d/0x2d2e3b3f34a79eac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.153651:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000098a1b88c/0x2d2e3b3f34a79e7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e74 expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.153659:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bc716b5d/0x2d2e3b3f34a79eac lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.153704:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000098a1b88c/0x2d2e3b3f34a79e7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a79e74 expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.153717:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000098a1b88c/0x2d2e3b3f34a79e7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e74 expref: 11 pid: 6503 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625044.153743:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875509206059904:0@lo:104: 00000100:00100000:0.0:1788625044.153783:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625044.153838:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 000000007ec78029 going to sleep for 11 seconds 00000100:00100000:2.0:1788625044.153891:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206059904 00000100:00100000:2.0:1788625044.153898:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206059904 00000100:00100000:2.0:1788625044.153951:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625044.153959:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ede48574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:6527:x1875509206059904:12345-0@lo:104: 00010000:00010000:2.0:1788625044.153973:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79e74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79e7b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625044.154030:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625044.154036:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ede48574 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:6527:x1875509206059904:12345-0@lo:104: Request processed in 79us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625044.154042:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788625044.154053:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625044.154060:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79e74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79e7b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.154069:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098f58715 already unused, calling callback (0000000091cf9fbc) 10000000:00010000:3.0:1788625044.154072:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79e74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a79e7b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.154080:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79e74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a79e7b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625044.154087:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79e74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a79e7b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625044.154092:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788625044.154132:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79e74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79e7b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.154139:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625044.154152:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79e74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79e7b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.154169:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79e74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79e7b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.154184:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625044.154186:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625044.154188:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625044.154260:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fc23574 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206060032:0@lo:103: 00000100:00100000:2.0:1788625044.154289:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625044.154336:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206060032 00000100:00100000:3.0:1788625044.154341:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206060032 00010000:00010000:3.0:1788625044.154360:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000098a1b88c/0x2d2e3b3f34a79e7b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e74 expref: 12 pid: 6503 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625044.154381:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625044.154388:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062dbf826 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:3636:x1875509206060032:12345-0@lo:103: 00010000:00010000:3.0:1788625044.154398:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625044.154401:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000098a1b88c/0x2d2e3b3f34a79e7b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e74 expref: 12 pid: 6503 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.154410:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000098a1b88c/0x2d2e3b3f34a79e7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e74 expref: 12 pid: 6503 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.154428:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bc716b5d/0x2d2e3b3f34a79eac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.154436:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc716b5d/0x2d2e3b3f34a79eac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.154440:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098a1b88c/0x2d2e3b3f34a79e7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e74 expref: 12 pid: 6503 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788625044.154452:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000832863s 00000100:00100000:0.0:1788625044.154455:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875509206059904:0@lo:104: 00010000:00010000:3.0:1788625044.154457:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bc716b5d/0x2d2e3b3f34a79eac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.154473:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bc716b5d/0x2d2e3b3f34a79eac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.154478:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bc716b5d/0x2d2e3b3f34a79eac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.154489:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bc716b5d/0x2d2e3b3f34a79eac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.154500:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bc716b5d/0x2d2e3b3f34a79eac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788625044.157714:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788625044.157903:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788625044.158084:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1788625044.158222:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788625044.158393:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788625044.158560:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:0.0:1788625044.159885:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: 00000000bc716b5d/0x2d2e3b3f34a79eac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625044.159900:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bc716b5d/0x2d2e3b3f34a79eac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.160004:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bc716b5d already unused, calling callback (0000000055fa61c0) 00010000:00010000:3.0:1788625044.160010:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bc716b5d/0x2d2e3b3f34a79eac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.160021:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bc716b5d/0x2d2e3b3f34a79eac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.160040:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bc716b5d/0x2d2e3b3f34a79eac lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.160048:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bc716b5d/0x2d2e3b3f34a79eac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625044.160069:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625044.160254:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062dbf826 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:3636:x1875509206060032:12345-0@lo:103: Request processed in 5865us (5962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625044.160264:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625044.160416:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fc23574 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206060032:0@lo:103: 00080000:10000000:1.0:1788625044.160428:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1788625044.160683:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788625044.161558:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1788625044.161803:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788625044.162023:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1788625044.162182:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1788625044.180542:0:6487:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788625044.193947:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788625044.194089:0:6543:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788625044.194094:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788625044.194559:0:6544:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788625044.197147:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788625044.197244:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788625044.199594:0:6487:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788625044.199623:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788625044.199887:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625044.202215:0:6544:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625044.202336:0:6487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788625044.202884:0:6487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788625044.202919:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788625044.203107:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788625044.203422:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1788625044.204141:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788625044.204427:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788625044.204623:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788625044.204762:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788625044.204899:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788625044.205013:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788625044.205116:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788625044.205243:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788625044.205731:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788625044.205890:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788625044.206036:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788625044.206183:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788625044.206311:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788625044.206583:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788625044.206746:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788625044.206883:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000040:00080000:3.0:1788625044.207014:0:6544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788625044.207084:0:6544:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788625044.207088:0:6544:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1788625044.207182:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788625044.207470:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788625044.207665:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788625044.207796:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788625044.207957:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788625044.208096:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788625044.208236:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788625044.208493:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788625044.208666:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788625044.208811:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788625044.208956:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788625044.209065:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788625044.209199:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788625044.209421:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788625044.209799:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788625044.209946:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788625044.210119:0:6487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788625044.218271:0:6487:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788625044.218310:0:6487:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa6ab0181b988 00100000:10000000:1.0:1788625044.218318:0:6487:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788625044.220022:0:6487:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788625044.220037:0:6487:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.114@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788625044.220057:0:6487:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788625044.220094:0:6487:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788625044.223238:0:6487:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788625044.223435:0:6487:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788625044.524756:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625045.582871:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625046.604143:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625047.632886:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625048.657658:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788625049.356869:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788625049.356877:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788625049.356880:0:38:0:(import.c:65:import_set_state_nolock()) 0000000027b7bf2e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625049.356893:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000027b7bf2e using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625049.356913:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001b6e4f4f x1875509206060288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788625049.356955:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b6e4f4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206060288:0@lo:38: 00000100:00100000:0.0:1788625049.357258:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625049.357269:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206060160:0@lo:400: 00000100:00100000:0.0:1788625049.357318:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625049.357385:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206060160 00000100:00100000:0.0:1788625049.357394:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206060160 00000100:00100000:0.0:1788625049.357435:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788625049.357443:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecad02e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:3638:x1875509206060160:12345-0@lo:400: 00000100:00100000:0.0:1788625049.357506:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecad02e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:3638:x1875509206060160:12345-0@lo:400: Request processed in 53us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625049.357645:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788625049.357702:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5791c4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206060160:0@lo:400: 00000100:00100000:1.0:1788625049.357839:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625049.358001:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206060288 00000100:00100000:0.0:1788625049.358007:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206060288 00000100:00100000:0.0:1788625049.358043:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788625049.358048:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ca233b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875509206060288:12345-0@lo:38: 00010000:00080000:0.0:1788625049.358070:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:0.0:1788625049.358107:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2d2e3b3f34a79eb3 00000004:00100000:0.0:1788625049.358275:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788625049.358416:0:6513:0:(import.c:65:import_set_state_nolock()) 00000000f7dac8fb : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625049.358470:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ca233b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875509206060288:12345-0@lo:38: Request processed in 420us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625049.358478:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788625049.362893:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001b6e4f4f x1875509206060288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788625049.362919:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788625049.362954:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788625049.362961:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788625049.362964:0:3634:0:(import.c:65:import_set_state_nolock()) 0000000027b7bf2e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788625049.362971:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b6e4f4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206060288:0@lo:38: 00010000:00010000:1.0:1788625049.677646:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788625050.120555:0:6789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788625050.700011:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788625051.177501:0:6841:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788625051.177816:0:6841:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788625051.736980:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788625051.916579:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788625051.916587:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998852348000 from 3 10000000:01000000:2.0:1788625051.916591:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788625051.916633:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79eba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625051.916646:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79eba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625051.916657:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79eba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625051.916708:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf86e70d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206060416:0@lo:101: 00000100:00100000:2.0:1788625051.916778:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625051.916827:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 000000004209c768 going to sleep for 11 seconds 00000100:00100000:1.0:1788625051.917079:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206060416 00000100:00100000:1.0:1788625051.917088:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206060416 00000100:00100000:1.0:1788625051.917186:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788625051.917195:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037cbce1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:6508:x1875509206060416:12345-0@lo:101: 00010000:00010000:1.0:1788625051.917208:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625051.917835:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005d90afa8/0x2d2e3b3f34a79ec1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79eba expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625051.917861:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005d90afa8/0x2d2e3b3f34a79ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79eba expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625051.917872:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005d90afa8/0x2d2e3b3f34a79ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79eba expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625051.917890:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005d90afa8, rc 0) 00000100:00100000:1.0:1788625051.917939:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037cbce1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:6508:x1875509206060416:12345-0@lo:101: Request processed in 746us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625051.917951:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788625051.918126:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf86e70d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206060416:0@lo:101: 00010000:00010000:1.0:1788625051.918141:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79eba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79ec1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625051.918149:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79eba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79ec1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625051.918202:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b6e4f4f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206060544:0@lo:256: 00000100:00100000:1.0:1788625051.918825:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625051.918863:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c9fd56f going to sleep for 11 seconds 00000100:00100000:2.0:1788625051.919312:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206060544 00000100:00100000:2.0:1788625051.919320:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206060544 00000100:00100000:2.0:1788625051.919375:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788625051.919383:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c0d644f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:6508:x1875509206060544:12345-0@lo:256: 20000000:01000000:2.0:1788625051.919403:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788625051.919418:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788625051.919421:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788625051.919532:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c0d644f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:6508:x1875509206060544:12345-0@lo:256: Request processed in 134us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625051.919540:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788625051.919892:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b6e4f4f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206060544:0@lo:256: 10000000:01000000:1.0:1788625051.919937:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788625051.919945:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79eba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79ec1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625051.919954:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79ec1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625052.752553:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625053.775431:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788625053.935737:0:6942:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788625053.935938:0:6942:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788625054.475667:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625054.477496:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625054.477534:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007995540b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206060800:0@lo:400: 00000100:00100000:1.0:1788625054.477604:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625054.477673:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206060800 00000100:00100000:1.0:1788625054.477680:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206060800 00000100:00100000:1.0:1788625054.477724:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788625054.477732:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008114230a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206060800:12345-0@lo:400: 00000100:00100000:1.0:1788625054.477791:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008114230a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206060800:12345-0@lo:400: Request processed in 60us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625054.477798:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788625054.477843:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007995540b x1875509206060800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625054.477856:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007995540b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206060800:0@lo:400: 00000100:00100000:2.0:1788625054.479621:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b6e4f4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206060672:0@lo:400: 00000100:00100000:2.0:1788625054.479680:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625054.479916:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206060672 00000100:00100000:1.0:1788625054.479923:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206060672 00000100:00100000:1.0:1788625054.480009:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788625054.480018:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000150ea175 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:3637:x1875509206060672:12345-0@lo:400: 00000100:00100000:1.0:1788625054.480076:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000150ea175 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:3637:x1875509206060672:12345-0@lo:400: Request processed in 60us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625054.480083:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788625054.480146:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b6e4f4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206060672:0@lo:400: 00010000:00010000:2.0:1788625054.796033:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625055.819854:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625056.844727:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625057.871358:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625058.893152:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625059.606381:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bac660d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206060928:0@lo:400: 00000100:00100000:2.0:1788625059.606453:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625059.606508:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000007a6d17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206061056:0@lo:400: 00000100:00100000:2.0:1788625059.606549:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625059.606584:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206060928 00000100:00100000:2.0:1788625059.606591:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206060928 00000100:00100000:2.0:1788625059.606637:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625059.606644:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000abca2dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:3636:x1875509206060928:12345-0@lo:400: 00000100:00100000:2.0:1788625059.606701:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000abca2dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:3636:x1875509206060928:12345-0@lo:400: Request processed in 57us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625059.606708:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625059.606744:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206061056 00000100:00100000:2.0:1788625059.606747:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206061056 00000100:00100000:2.0:1788625059.606771:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625059.606776:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b413b7a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206061056:12345-0@lo:400: 00000100:00100000:2.0:1788625059.606805:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b413b7a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206061056:12345-0@lo:400: Request processed in 30us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625059.606811:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788625059.606847:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000007a6d17 x1875509206061056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625059.606860:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000007a6d17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206061056:0@lo:400: 00000100:00100000:2.0:1788625059.606886:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bac660d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206060928:0@lo:400: 00010000:00010000:2.0:1788625059.917539:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625060.940420:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625061.963806:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625062.991075:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625064.011937:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788625064.655323:0:7441:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788625064.655327:0:7441:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788625064.655329:0:7441:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788625064.655472:0:7441:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c90971d5 00000020:01000004:3.0:1788625064.655487:0:7441:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1788625064.655499:0:7441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788625064.655511:0:7441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000a0dff397) 00000020:00000080:3.0:1788625064.655585:0:7441:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00000100:00100000:2.0:1788625064.719462:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007995540b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206061184:0@lo:400: 00000100:00100000:2.0:1788625064.719801:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625064.722047:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082329f0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206061312:0@lo:400: 00000100:00100000:2.0:1788625064.722103:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625064.726224:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206061312 00000100:00100000:0.0:1788625064.726240:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206061312 00000100:00100000:0.0:1788625064.726310:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625064.726320:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bac660d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206061312:12345-0@lo:400: 00000100:00100000:0.0:1788625064.726412:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bac660d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206061312:12345-0@lo:400: Request processed in 94us (4309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625064.726420:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788625064.726467:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000082329f0d x1875509206061312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625064.726482:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082329f0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206061312:0@lo:400: 00000100:00100000:1.0:1788625064.726745:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206061184 00000100:00100000:1.0:1788625064.726751:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206061184 00000100:00100000:1.0:1788625064.726783:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788625064.726789:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043ea7dfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:3638:x1875509206061184:12345-0@lo:400: 00000100:00100000:1.0:1788625064.726831:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043ea7dfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:3638:x1875509206061184:12345-0@lo:400: Request processed in 43us (7032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625064.726837:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788625064.729451:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007995540b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206061184:0@lo:400: 00100000:10000000:2.0:1788625064.737778:0:7441:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788625064.737844:0:7441:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788625064.776407:0:7441:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788625064.776672:0:7441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788625064.776683:0:7441:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788625064.776692:0:7441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a79ecf 00000020:01000004:2.0:1788625064.776699:0:7441:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788625064.776726:0:7441:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788625064.776729:0:7441:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788625064.776734:0:7441:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788625064.777111:0:7441:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788625064.777116:0:7441:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.114@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788625064.805994:0:7441:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788625064.806038:0:7441:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.114@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1788625064.806042:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788625064.806044:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788625064.806045:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625064.806047:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625064.806048:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625064.806049:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625064.806050:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788625064.806051:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788625064.806053:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788625064.806054:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625064.806055:0:7441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788625064.806059:0:7441:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1788625064.806061:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788625064.806062:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788625064.806063:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625064.806064:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625064.806065:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625064.806066:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625064.806067:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788625064.806068:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788625064.806073:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788625064.806074:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625064.806075:0:7441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788625064.806100:0:7441:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788625064.806117:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018fb4bcb pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206061440:0@lo:253: 00000100:00100000:3.0:1788625064.806207:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625064.806257:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000724a1afe going to sleep for 11 seconds 00000100:00100000:2.0:1788625064.806677:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206061440 00000100:00100000:2.0:1788625064.806686:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206061440 00000100:00100000:2.0:1788625064.806741:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788625064.806749:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a8bdc20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:7441:x1875509206061440:12345-0@lo:253: 20000000:01000000:2.0:1788625064.806781:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788625064.806785:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1788625064.806790:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1788625064.806793:0:6506:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1788625064.806827:0:6506:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1788625064.807025:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625064.807163:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788625064.807177:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788625064.807211:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788625064.807229:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788625064.807243:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788625064.807496:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1788625064.807504:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1788625064.807591:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1788625064.807599:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1788625064.807613:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1788625064.807618:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1788625064.807632:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788625064.807648:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788625064.807774:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1788625064.807792:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.114@tcp (null) (null) (null) 00000040:00080000:2.0:1788625064.807807:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1788625064.807822:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788625064.807839:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1788625064.807845:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.114@tcp (null) (null) 00000040:00080000:2.0:1788625064.807865:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1788625064.807871:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788625064.807884:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788625064.807902:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788625064.807913:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788625064.807988:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1788625064.807997:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1788625064.808007:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788625064.808019:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788625064.808035:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1788625064.808040:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1788625064.808051:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788625064.808069:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788625064.808073:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1788625064.808094:0:6506:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788625064.808100:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1788625064.810464:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788625064.810855:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788625064.810886:0:6506:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.114@tcp for mdt 20000000:01000000:0.0:1788625064.810889:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.114@tcp (null) (null) (null) 00000040:00080000:0.0:1788625064.810907:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788625064.810929:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788625064.810946:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788625064.810953:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.114@tcp (null) (null) 00000040:00080000:0.0:1788625064.810973:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788625064.810983:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1788625064.810998:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1788625064.811016:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1788625064.811076:0:6506:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1788625064.811085:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1788625064.811838:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1788625064.812063:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788625064.812079:0:6506:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.114@tcp for mdt 20000000:01000000:0.0:1788625064.812081:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.114@tcp (null) (null) (null) 00000040:00080000:0.0:1788625064.812115:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788625064.812123:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788625064.812138:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788625064.812144:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.114@tcp (null) (null) 00000040:00080000:0.0:1788625064.812158:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788625064.812165:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1788625064.812177:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788625064.812210:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1788625064.812230:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788625064.812234:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788625064.812238:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788625064.812303:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788625064.812305:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788625064.818648:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788625064.818714:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788625064.818731:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788625064.818967:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1788625064.818988:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1788625064.819000:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1788625064.819010:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788625064.819012:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788625064.819561:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788625064.819581:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788625064.819595:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788625064.819737:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788625064.819760:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788625064.819785:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788625064.819795:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788625064.819797:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788625064.820742:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788625064.820769:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788625064.820801:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1788625064.820939:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788625064.820957:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788625064.820970:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1788625064.820981:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788625064.820983:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788625064.820994:0:6506:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788625064.821001:0:6506:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788625064.821256:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788625064.826115:0:6506:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788625064.843181:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788625064.844007:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d438cb2e/0x2d2e3b3f34a79ed6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625064.844032:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79e0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e04 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625064.844040:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a376f74d/0x2d2e3b3f34a79e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e20 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625064.844047:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79e97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e90 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625064.844054:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d438cb2e/0x2d2e3b3f34a79ed6 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625064.844105:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a79e90 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625064.844121:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79e97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e90 expref: 12 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625064.844138:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036e24624 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206061568:0@lo:104: 00000100:00100000:3.0:1788625064.844943:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625064.845059:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a376f74d/0x2d2e3b3f34a79e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a79e20 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625064.845088:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a376f74d/0x2d2e3b3f34a79e27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e20 expref: 12 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625064.845100:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a216aad pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206061696:0@lo:104: 00000100:00100000:3.0:1788625064.845130:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625064.845439:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79e0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a79e04 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625064.845448:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79e0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e04 expref: 12 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625064.845456:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036b56cb3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206061824:0@lo:104: 00000100:00100000:3.0:1788625064.845481:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625064.845721:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206061568 00000100:00100000:2.0:1788625064.845729:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206061568 00000100:00100000:2.0:1788625064.845771:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206061696 00000100:00100000:2.0:1788625064.845774:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206061696 00000100:00100000:2.0:1788625064.845788:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625064.845795:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb9185ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:6506:x1875509206061568:12345-0@lo:104: 00010000:00010000:2.0:1788625064.845807:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79e97 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.845890:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625064.845894:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb9185ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:6506:x1875509206061568:12345-0@lo:104: Request processed in 100us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625064.845901:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625064.845916:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625064.845921:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7580a27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:6506:x1875509206061696:12345-0@lo:104: 00010000:00010000:2.0:1788625064.845927:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79e27 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625064.846037:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 00000000750feb96 going to sleep for 11 seconds 00000100:00100000:3.0:1788625064.846057:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036e24624 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206061568:0@lo:104: 00000100:00100000:3.0:1788625064.846063:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a216aad pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206061696:0@lo:104: 00010000:00010000:1.0:1788625064.846107:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625064.846114:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79e97 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.846120:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e154ef63 already unused, calling callback (0000000091cf9fbc) 10000000:00010000:1.0:1788625064.846124:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a79e97 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.846131:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a79e97 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625064.846136:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a79e97 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625064.846141:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625064.846174:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79e90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79e97 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.846181:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625064.846476:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79e90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79e97 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.846484:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79e90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79e97 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.846511:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625064.846513:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79e27 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.846558:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000080a91bfa already unused, calling callback (0000000091cf9fbc) 10000000:00010000:1.0:1788625064.846561:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a79e27 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.846567:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a79e27 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625064.846572:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a79e27 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625064.846576:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625064.846595:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79e20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79e27 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.846600:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625064.846612:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79e20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79e27 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.846617:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79e20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79e27 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.846625:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625064.846626:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625064.846628:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625064.846634:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625064.846652:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e06d1d08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206062080:0@lo:103: 00000100:00100000:1.0:1788625064.846706:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625064.846789:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625064.846798:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007995540b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206061952:0@lo:103: 00000100:00100000:3.0:1788625064.846824:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625064.846897:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206062080 00000100:00100000:1.0:1788625064.846902:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206062080 00010000:00010000:1.0:1788625064.846923:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a376f74d/0x2d2e3b3f34a79e27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e20 expref: 13 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625064.846952:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206061952 00000100:00100000:1.0:1788625064.846955:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206061952 00010000:00010000:1.0:1788625064.846965:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79e97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e90 expref: 14 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625064.846979:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788625064.846984:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066d922ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:3638:x1875509206062080:12345-0@lo:103: 00010000:00010000:1.0:1788625064.846995:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625064.847001:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a376f74d/0x2d2e3b3f34a79e27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e20 expref: 14 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.847010:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a376f74d/0x2d2e3b3f34a79e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e20 expref: 14 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.847025:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a376f74d/0x2d2e3b3f34a79e27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e20 expref: 14 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.847040:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625064.847073:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066d922ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+13:3638:x1875509206062080:12345-0@lo:103: Request processed in 89us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625064.847080:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788625064.847095:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788625064.847100:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fcad036b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:3635:x1875509206061952:12345-0@lo:103: 00010000:00010000:1.0:1788625064.847113:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625064.847117:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79e97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e90 expref: 12 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.847125:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e90 expref: 12 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.847134:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79e97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e90 expref: 12 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.847141:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625064.847163:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fcad036b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:3635:x1875509206061952:12345-0@lo:103: Request processed in 64us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625064.847169:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788625064.847443:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007995540b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206061952:0@lo:103: 00000100:00100000:1.0:1788625064.847584:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e06d1d08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206062080:0@lo:103: 00000100:00100000:0.0:1788625064.847715:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206061824 00000100:00100000:0.0:1788625064.847721:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206061824 00010000:00010000:2.0:1788625064.847836:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788625064.847843:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7580a27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:6506:x1875509206061696:12345-0@lo:104: Request processed in 1921us (2712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625064.847849:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625064.847865:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625064.847879:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6218634 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:6506:x1875509206061824:12345-0@lo:104: 00010000:00010000:2.0:1788625064.847887:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: 00000000d46bc6c5/0x2d2e3b3f34a79e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79e0b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625064.847969:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036b56cb3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206061824:0@lo:104: 00010000:00010000:3.0:1788625064.847988:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d438cb2e/0x2d2e3b3f34a79ed6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848023:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625064.848027:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: 00000000d46bc6c5/0x2d2e3b3f34a79e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79e0b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848034:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d46bc6c5 already unused, calling callback (0000000091cf9fbc) 10000000:00010000:0.0:1788625064.848036:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: 00000000d46bc6c5/0x2d2e3b3f34a79e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a79e0b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848052:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: 00000000d46bc6c5/0x2d2e3b3f34a79e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a79e0b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625064.848058:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: 00000000d46bc6c5/0x2d2e3b3f34a79e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a79e0b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625064.848064:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625064.848120:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: 00000000d46bc6c5/0x2d2e3b3f34a79e04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79e0b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848126:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625064.848140:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: 00000000d46bc6c5/0x2d2e3b3f34a79e04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79e0b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848146:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: 00000000d46bc6c5/0x2d2e3b3f34a79e04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79e0b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848160:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625064.848162:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625064.848163:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625064.848203:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:0.0:1788625064.848330:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625064.848452:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6218634 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:6506:x1875509206061824:12345-0@lo:104: Request processed in 575us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625064.848459:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625064.848478:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625064.848488:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206062208:0@lo:103: 00000100:00100000:2.0:1788625064.848545:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625064.848667:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206062208 00000100:00100000:0.0:1788625064.848671:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206062208 00010000:00010000:0.0:1788625064.848688:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79e0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e04 expref: 11 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625064.848756:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625064.848763:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000007a6d17 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:3637:x1875509206062208:12345-0@lo:103: 00010000:00010000:0.0:1788625064.848774:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625064.848786:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79e0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e04 expref: 11 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848795:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79e0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e04 expref: 11 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848805:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79e0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e04 expref: 11 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848819:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d438cb2e/0x2d2e3b3f34a79ed6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848827:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d438cb2e/0x2d2e3b3f34a79ed6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848839:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d438cb2e/0x2d2e3b3f34a79ed6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848845:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d438cb2e/0x2d2e3b3f34a79ed6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848850:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d438cb2e/0x2d2e3b3f34a79ed6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848855:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d438cb2e/0x2d2e3b3f34a79ed6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848860:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d438cb2e already unused, calling callback (0000000055fa61c0) 00010000:00010000:0.0:1788625064.848863:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d438cb2e/0x2d2e3b3f34a79ed6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848868:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d438cb2e/0x2d2e3b3f34a79ed6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848896:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d438cb2e/0x2d2e3b3f34a79ed6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.848906:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625064.848942:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000007a6d17 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+10:3637:x1875509206062208:12345-0@lo:103: Request processed in 181us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625064.848948:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788625064.848989:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d438cb2e/0x2d2e3b3f34a79ed6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.848996:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d438cb2e/0x2d2e3b3f34a79ed6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.849002:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d438cb2e/0x2d2e3b3f34a79ed6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788625064.849018:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788625064.849840:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206062208:0@lo:103: 00000100:00100000:3.0:1788625064.854585:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018fb4bcb pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206061440:0@lo:253: 10000000:01000000:3.0:1788625064.854606:0:7441:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788625064.854626:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788625064.854628:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788625064.854629:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625064.854630:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1788625064.854631:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625064.854633:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625064.854634:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788625064.854635:0:7441:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788625064.854636:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625064.854638:0:7441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788625064.854663:0:7441:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c90971d5 from lustre-MDT0001 10000000:01000000:3.0:1788625064.854695:0:7441:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788625064.854697:0:7441:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788625064.854704:0:7441:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99885ecd99c0 local copy 10000000:01000000:3.0:1788625064.854707:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788625064.854746:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 0000000098a1b88c/0x2d2e3b3f34a79edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625064.854757:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.114@tcp lock: 0000000098a1b88c/0x2d2e3b3f34a79edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625064.854766:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 0000000098a1b88c/0x2d2e3b3f34a79edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625064.854784:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018fb4bcb pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206062336:0@lo:101: 00000100:00100000:3.0:1788625064.854849:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625064.855088:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a8bdc20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+9:7441:x1875509206061440:12345-0@lo:253: Request processed in 48338us (48879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625064.855101:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788625064.855151:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206062336 00000100:00100000:2.0:1788625064.855158:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206062336 00000100:00100000:2.0:1788625064.855220:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788625064.855228:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008fa22bff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+9:7441:x1875509206062336:12345-0@lo:101: 00010000:00010000:2.0:1788625064.855241:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625064.855273:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000098f58715/0x2d2e3b3f34a79ee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79edd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.855297:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098f58715/0x2d2e3b3f34a79ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79edd expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.855308:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000098f58715/0x2d2e3b3f34a79ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79edd expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.855328:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000098f58715, rc 0) 00000100:00100000:2.0:1788625064.855363:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008fa22bff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+10:7441:x1875509206062336:12345-0@lo:101: Request processed in 137us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625064.855369:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788625064.856075:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035d91822 going to sleep for 11 seconds 00000100:00100000:3.0:1788625064.856102:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018fb4bcb pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206062336:0@lo:101: 00010000:00010000:3.0:1788625064.856119:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 0000000098a1b88c/0x2d2e3b3f34a79edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2d2e3b3f34a79ee4 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625064.856129:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 0000000098a1b88c/0x2d2e3b3f34a79edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2d2e3b3f34a79ee4 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625064.856439:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018fb4bcb pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206062464:0@lo:501: 00000100:00100000:3.0:1788625064.856481:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625064.856537:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035d91822 going to sleep for 11 seconds 00000100:00100000:2.0:1788625064.856716:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206062464 00000100:00100000:2.0:1788625064.856722:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206062464 00000100:00100000:2.0:1788625064.856751:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788625064.856758:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aad30bc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+10:7441:x1875509206062464:12345-0@lo:501: 00000100:00100000:2.0:1788625064.856831:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aad30bc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+10:7441:x1875509206062464:12345-0@lo:501: Request processed in 73us (349us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625064.856838:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788625064.856912:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018fb4bcb pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206062464:0@lo:501: 10000000:01000000:0.0:1788625064.856927:0:7441:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788625064.856950:0:7441:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788625064.856954:0:7441:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 0000000098a1b88c/0x2d2e3b3f34a79edd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2d2e3b3f34a79ee4 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.856961:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 0000000098a1b88c/0x2d2e3b3f34a79edd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2d2e3b3f34a79ee4 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.856968:0:7441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: 0000000098a1b88c/0x2d2e3b3f34a79edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2d2e3b3f34a79ee4 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.856991:0:7441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788625064.857018:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99886c323000 10000000:01000000:0.0:1788625064.857023:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788625064.857027:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99885ecd99c0 10000000:01000000:0.0:1788625064.857030:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788625064.857033:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99885ecd99c0 from 1 10000000:01000000:0.0:1788625064.857035:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788625064.857062:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 00000000bc716b5d/0x2d2e3b3f34a79eeb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.857068:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 00000000bc716b5d/0x2d2e3b3f34a79eeb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.857075:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 00000000bc716b5d/0x2d2e3b3f34a79eeb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625064.857087:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206062592:0@lo:101: 00000100:00100000:0.0:1788625064.857114:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625064.857127:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021d61399 going to sleep for 11 seconds 00010000:00010000:2.0:1788625064.857179:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625064.857196:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: 0000000098a1b88c/0x2d2e3b3f34a79edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2d2e3b3f34a79ee4 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.857203:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098a1b88c already unused, calling callback (0000000091cf9fbc) 10000000:00010000:2.0:1788625064.857212:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: 0000000098a1b88c/0x2d2e3b3f34a79edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2d2e3b3f34a79ee4 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.857219:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: 0000000098a1b88c/0x2d2e3b3f34a79edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2d2e3b3f34a79ee4 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625064.857235:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: 0000000098a1b88c/0x2d2e3b3f34a79edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x2d2e3b3f34a79ee4 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625064.857240:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788625064.857264:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: 0000000098a1b88c/0x2d2e3b3f34a79edd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2d2e3b3f34a79ee4 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.857270:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625064.857295:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: 0000000098a1b88c/0x2d2e3b3f34a79edd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2d2e3b3f34a79ee4 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.857302:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: 0000000098a1b88c/0x2d2e3b3f34a79edd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2d2e3b3f34a79ee4 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625064.857499:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f9730b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206062720:0@lo:103: 00000100:00100000:0.0:1788625064.857550:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625064.857592:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206062720 00000100:00100000:0.0:1788625064.857596:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206062720 00000100:00100000:0.0:1788625064.857633:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625064.857640:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2e874b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+10:3635:x1875509206062720:12345-0@lo:103: 00010000:00010000:0.0:1788625064.857649:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625064.857661:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098f58715/0x2d2e3b3f34a79ee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a79edd expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.857678:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625064.857704:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2e874b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+9:3635:x1875509206062720:12345-0@lo:103: Request processed in 66us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625064.857710:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625064.857739:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f9730b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206062720:0@lo:103: 00010000:00010000:2.0:1788625064.857876:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625064.857878:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625064.857880:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625064.857894:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206062592 00000100:00100000:2.0:1788625064.857899:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206062592 00000100:00100000:2.0:1788625064.857920:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788625064.857925:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de860bdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+9:7441:x1875509206062592:12345-0@lo:101: 00010000:00010000:2.0:1788625064.857935:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625064.857947:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000875c3637/0x2d2e3b3f34a79ef2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79eeb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.857964:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000875c3637/0x2d2e3b3f34a79ef2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79eeb expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.857973:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000875c3637/0x2d2e3b3f34a79ef2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79eeb expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.857988:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000875c3637, rc 0) 00000100:00100000:2.0:1788625064.858028:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de860bdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+10:7441:x1875509206062592:12345-0@lo:101: Request processed in 104us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625064.858034:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788625064.858100:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206062592:0@lo:101: 00010000:00010000:0.0:1788625064.858118:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 00000000bc716b5d/0x2d2e3b3f34a79eeb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79ef2 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.858125:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 00000000bc716b5d/0x2d2e3b3f34a79eeb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79ef2 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625064.858141:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788625064.858158:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 00000000bc716b5d/0x2d2e3b3f34a79eeb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79ef2 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.858164:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 00000000bc716b5d/0x2d2e3b3f34a79eeb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79ef2 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625064.858172:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99886c323000 10000000:01000000:0.0:1788625064.858176:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788625064.858179:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99886c323000 from 1 10000000:01000000:0.0:1788625064.858181:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788625064.858216:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 000000006f4d0f2a/0x2d2e3b3f34a79ef9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.858222:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 000000006f4d0f2a/0x2d2e3b3f34a79ef9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.858228:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 000000006f4d0f2a/0x2d2e3b3f34a79ef9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625064.858240:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206062848:0@lo:101: 00000100:00100000:0.0:1788625064.858278:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625064.858292:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021d61399 going to sleep for 11 seconds 00000100:00100000:2.0:1788625064.858579:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206062848 00000100:00100000:2.0:1788625064.858584:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206062848 00000100:00100000:2.0:1788625064.858605:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788625064.858610:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038a7af0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+10:7441:x1875509206062848:12345-0@lo:101: 00010000:00010000:2.0:1788625064.858618:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625064.858626:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004ba98a42/0x2d2e3b3f34a79f00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79ef9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.858641:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ba98a42/0x2d2e3b3f34a79f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79ef9 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.858648:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004ba98a42/0x2d2e3b3f34a79f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79ef9 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.858655:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004ba98a42, rc 0) 00000100:00100000:2.0:1788625064.858688:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038a7af0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:7441:x1875509206062848:12345-0@lo:101: Request processed in 78us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625064.858694:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788625064.858776:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206062848:0@lo:101: 00010000:00010000:0.0:1788625064.858794:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 000000006f4d0f2a/0x2d2e3b3f34a79ef9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f00 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.858801:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 000000006f4d0f2a/0x2d2e3b3f34a79ef9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79f00 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625064.858812:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788625064.858827:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 000000006f4d0f2a/0x2d2e3b3f34a79ef9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f00 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.858834:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 000000006f4d0f2a/0x2d2e3b3f34a79ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f00 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625064.858839:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788625064.858843:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788625064.858848:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99886c323000 10000000:01000000:0.0:1788625064.858850:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788625064.858853:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788625064.858855:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788625064.858870:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 00000000d9a5448b/0x2d2e3b3f34a79f07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.858877:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 00000000d9a5448b/0x2d2e3b3f34a79f07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.858883:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 00000000d9a5448b/0x2d2e3b3f34a79f07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625064.858895:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206062976:0@lo:101: 00000100:00100000:0.0:1788625064.858922:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625064.858942:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021d61399 going to sleep for 11 seconds 00000100:00100000:2.0:1788625064.858990:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206062976 00000100:00100000:2.0:1788625064.858994:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206062976 00000100:00100000:2.0:1788625064.859012:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788625064.859017:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009436f284 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:7441:x1875509206062976:12345-0@lo:101: 00010000:00010000:2.0:1788625064.859024:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625064.859038:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce7d7c35/0x2d2e3b3f34a79f0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79f07 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.859051:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce7d7c35/0x2d2e3b3f34a79f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79f07 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.859059:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce7d7c35/0x2d2e3b3f34a79f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79f07 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.859065:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce7d7c35, rc 0) 00000100:00100000:2.0:1788625064.859102:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009436f284 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:7441:x1875509206062976:12345-0@lo:101: Request processed in 85us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625064.859107:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788625064.859165:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206062976:0@lo:101: 00010000:00010000:0.0:1788625064.859175:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 00000000d9a5448b/0x2d2e3b3f34a79f07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f0e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625064.859194:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 00000000d9a5448b/0x2d2e3b3f34a79f07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79f0e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625064.859295:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206063104:0@lo:501: 00000100:00100000:0.0:1788625064.859621:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625064.859642:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021d61399 going to sleep for 11 seconds 00000100:00100000:2.0:1788625064.859684:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206063104 00000100:00100000:2.0:1788625064.859688:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206063104 00000100:00100000:2.0:1788625064.859710:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625064.859715:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068979c60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:7441:x1875509206063104:12345-0@lo:501: 00000100:00100000:2.0:1788625064.859818:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068979c60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:7441:x1875509206063104:12345-0@lo:501: Request processed in 103us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625064.859824:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788625064.860082:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206063104:0@lo:501: 00000100:00100000:0.0:1788625064.860125:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206063232:0@lo:503: 00000100:00100000:0.0:1788625064.860157:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625064.860199:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021d61399 going to sleep for 11 seconds 00000100:00100000:2.0:1788625064.860379:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206063232 00000100:00100000:2.0:1788625064.860384:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206063232 00000100:00100000:2.0:1788625064.860474:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788625064.860480:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000443c378e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:7441:x1875509206063232:12345-0@lo:503: 00000100:00100000:2.0:1788625064.860581:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000443c378e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:7441:x1875509206063232:12345-0@lo:503: Request processed in 102us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625064.860588:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788625064.860714:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206063232:0@lo:503: 00000040:00080000:0.0:1788625064.860966:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788625064.861034:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206063360:0@lo:502: 00000100:00100000:0.0:1788625064.861064:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625064.861083:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fa50772d going to sleep for 11 seconds 00000100:00100000:3.0:1788625064.861132:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206063360 00000100:00100000:3.0:1788625064.861136:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206063360 00000100:00100000:3.0:1788625064.861164:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788625064.861169:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002430f34a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:7441:x1875509206063360:12345-0@lo:502: 00000100:00100000:3.0:1788625064.861270:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002430f34a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:7441:x1875509206063360:12345-0@lo:502: Request processed in 102us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625064.861277:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788625064.861626:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206063360:0@lo:502: 00000040:00080000:0.0:1788625064.861940:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788625064.861966:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1788625064.861982:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1788625064.861996:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1788625064.862009:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1788625064.862024:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1788625064.862045:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1788625064.862055:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1788625064.862065:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1788625064.862076:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1788625064.862087:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1788625064.862097:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1788625064.862107:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1788625064.862118:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1788625064.862130:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1788625064.862140:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1788625064.862152:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1788625064.862176:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1788625064.862673:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1788625064.862696:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1788625064.862709:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1788625064.862721:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1788625064.862733:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1788625064.862763:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206063488:0@lo:502: 00000100:00100000:0.0:1788625064.862818:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625064.862901:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fa50772d going to sleep for 11 seconds 00000100:00100000:3.0:1788625064.862936:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206063488 00000100:00100000:3.0:1788625064.862942:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206063488 00000100:00100000:3.0:1788625064.863013:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788625064.863021:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7758690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:7441:x1875509206063488:12345-0@lo:502: 00000100:00100000:3.0:1788625064.863128:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7758690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:7441:x1875509206063488:12345-0@lo:502: Request processed in 108us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625064.863135:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788625064.863512:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002613a292 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206063488:0@lo:502: 00000040:00080000:0.0:1788625064.863849:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1788625064.863858:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1788625064.864364:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625064.864375:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625064.864377:0:7453:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788625064.864382:0:7453:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788625064.864385:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625064.864557:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000f5bc0749) 00000020:00000080:0.0:1788625064.864579:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1788625064.864587:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788625064.864672:0:7453:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788625064.864678:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a79f1c 00000020:00000080:0.0:1788625064.864908:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788625064.864912:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625064.864915:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625064.864917:0:7453:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788625064.864920:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625064.864923:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625064.864925:0:7453:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788625064.864928:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625064.864935:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000068d44610) 00000020:00000080:0.0:1788625064.864945:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1788625064.864948:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788625064.864950:0:7453:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788625064.864952:0:7453:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788625064.864958:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788625064.865010:0:7453:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c90971d5 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788625064.865030:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000a6c5a35f) 00000020:00000080:0.0:1788625064.865039:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1788625064.865088:0:7453:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788625064.865092:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a79f31 00000020:00000080:0.0:1788625064.865177:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788625064.865197:0:7453:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788625064.865202:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2d2e3b3f34a79f38 00080000:01000000:0.0:1788625064.865207:0:7453:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788625064.865210:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a79f3f 00080000:10000000:0.0:1788625064.869864:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788625064.870012:0:7453:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1788625064.947340:0:7453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1788625064.947802:0:7453:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1788625064.952020:0:7453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788625064.952631:0:7453:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788625064.976478:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788625064.976505:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625064.976541:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625064.976544:0:7453:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788625064.976560:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625064.976575:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625064.976577:0:7453:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788625064.976581:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788625064.976586:0:7453:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:00000080:0.0:1788625064.976617:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625064.976632:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000004a7e4272) 00000020:00000080:0.0:1788625064.976657:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788625064.976662:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788625064.976740:0:7453:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788625064.976747:0:7453:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788625064.976753:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a79f4d 00010000:00080000:0.0:1788625064.976782:0:7453:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a2c407b7@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.114@tcp at head 00010000:00010000:0.0:1788625064.986294:0:7453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1788625064.987263:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788625064.987278:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788625064.987323:0:7453:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788625064.987343:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a79f54 00000100:00080000:2.0:1788625064.987352:0:7453:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625064.987357:0:7453:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000a2c407b7 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625064.987568:0:7453:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000070246cb2 x1875509206063616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788625064.987591:0:7453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788625064.987673:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018e3ff2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206063744:0@lo:400: 00000100:00100000:2.0:1788625064.987739:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625064.987809:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d776827 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206063872:0@lo:400: 00000100:00100000:2.0:1788625064.987838:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625064.987876:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206063744 00000100:00100000:2.0:1788625064.987883:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206063744 00000100:00100000:2.0:1788625064.987922:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788625064.987931:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec2e708b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:3636:x1875509206063744:12345-0@lo:400: 00000100:00100000:2.0:1788625064.987975:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec2e708b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:3636:x1875509206063744:12345-0@lo:400: Request processed in 45us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625064.987981:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788625064.988012:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206063872 00000100:00100000:2.0:1788625064.988016:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206063872 00000100:00100000:2.0:1788625064.988042:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625064.988048:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a9be1f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206063872:12345-0@lo:400: 00000100:00100000:2.0:1788625064.988082:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a9be1f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206063872:12345-0@lo:400: Request processed in 35us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625064.988088:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788625064.988125:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009d776827 x1875509206063872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625064.988151:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d776827 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206063872:0@lo:400: 00000100:00100000:2.0:1788625064.988192:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018e3ff2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206063744:0@lo:400: 00000020:01000000:2.0:1788625064.988245:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625064.988249:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625064.988251:0:7453:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788625064.988254:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788625064.988256:0:7453:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788625064.988258:0:7453:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625064.988259:0:7453:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625064.988261:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788625064.988263:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625064.988264:0:7453:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788625064.988266:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625064.988270:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625064.988271:0:7453:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788625064.988275:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788625064.988322:0:7453:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788625064.988336:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625064.988339:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625064.988340:0:7453:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788625064.988342:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625064.988344:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625064.988345:0:7453:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788625064.988347:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788625064.988349:0:7453:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788625064.988376:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625064.988379:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625064.988380:0:7453:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788625064.988383:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:2.0:1788625064.988852:0:7441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1788625064.988879:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788625064.988899:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 00000000d9a5448b/0x2d2e3b3f34a79f07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f0e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.988909:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 00000000d9a5448b/0x2d2e3b3f34a79f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f0e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625064.988916:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99886c323000 from 1 10000000:01000000:2.0:1788625064.988919:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788625064.988942:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.988949:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.988957:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625064.988972:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018e3ff2b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206064000:0@lo:101: 00000100:00100000:2.0:1788625064.989006:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625064.989032:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b5a01f5 going to sleep for 11 seconds 00000100:00100000:2.0:1788625064.989057:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206064000 00000100:00100000:2.0:1788625064.989061:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206064000 00000100:00100000:2.0:1788625064.989087:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788625064.989093:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001d81271 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+12:7441:x1875509206064000:12345-0@lo:101: 00010000:00010000:2.0:1788625064.989102:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625064.989112:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79f62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79f5b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.989131:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79f5b expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.989150:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79f5b expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625064.989158:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000047900784, rc 0) 00000100:00100000:2.0:1788625064.989940:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001d81271 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+13:7441:x1875509206064000:12345-0@lo:101: Request processed in 843us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625064.989949:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788625064.990994:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000070246cb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206063616:0@lo:38: 00000100:00100000:1.0:1788625064.991070:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625064.991165:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018e3ff2b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206064000:0@lo:101: 00010000:00010000:1.0:1788625064.991198:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f62 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.991209:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79f62 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625064.991852:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a96dd81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206064128:0@lo:256: 00000100:00100000:1.0:1788625064.991895:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625064.991926:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000004629dd57 going to sleep for 11 seconds 00000100:00100000:0.0:1788625064.991997:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206064128 00000100:00100000:0.0:1788625064.992005:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206064128 00000100:00100000:0.0:1788625064.992044:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788625064.992051:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f95cb29f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+13:7441:x1875509206064128:12345-0@lo:256: 20000000:01000000:0.0:1788625064.992070:0:6503:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788625064.993164:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788625064.993171:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788625064.993560:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f95cb29f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+13:7441:x1875509206064128:12345-0@lo:256: Request processed in 1507us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625064.993571:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788625064.994498:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206063616 00000100:00100000:3.0:1788625064.994510:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206063616 00000100:00100000:3.0:1788625064.994851:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625064.994857:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e06d1d08 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875509206063616:12345-0@lo:38: 00010000:00080000:3.0:1788625064.994887:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:3.0:1788625064.994927:0:6516:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a79f69 00000004:00100000:3.0:1788625064.994944:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788625064.994950:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788625064.997072:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a96dd81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206064128:0@lo:256: 10000000:01000000:1.0:1788625064.997890:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788625064.997931:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79f5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f62 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.997943:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f62 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625064.997951:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99886c323000 from 1 10000000:01000000:1.0:1788625064.997953:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625064.997988:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79f70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.997995:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79f70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.998003:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79f70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625064.998021:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a96dd81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206064256:0@lo:101: 00000100:00100000:1.0:1788625064.998079:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625064.998124:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000004629dd57 going to sleep for 11 seconds 00000100:00100000:3.0:1788625064.998141:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206064256 00000100:00100000:3.0:1788625064.998148:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206064256 00000100:00100000:3.0:1788625064.998214:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788625064.998223:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a246b261 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+13:7441:x1875509206064256:12345-0@lo:101: 00010000:00010000:3.0:1788625064.998235:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625064.998256:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006e4e099c/0x2d2e3b3f34a79f77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79f70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625064.998279:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e4e099c/0x2d2e3b3f34a79f77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79f70 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625064.998288:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006e4e099c/0x2d2e3b3f34a79f77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79f70 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625064.998297:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006e4e099c, rc 0) 00000100:00100000:3.0:1788625064.998357:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a246b261 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:7441:x1875509206064256:12345-0@lo:101: Request processed in 135us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625064.998363:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788625064.998773:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a96dd81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206064256:0@lo:101: 00010000:00010000:1.0:1788625064.998785:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79f70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f77 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625064.998805:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79f70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79f77 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625064.998901:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a96dd81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206064384:0@lo:501: 00000100:00100000:1.0:1788625064.998933:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625064.999012:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000004629dd57 going to sleep for 11 seconds 00000100:00100000:2.0:1788625065.004276:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206064384 00000100:00100000:2.0:1788625065.004293:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206064384 00000100:00100000:2.0:1788625065.004366:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788625065.004375:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021af31e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:7441:x1875509206064384:12345-0@lo:501: 00000100:00100000:2.0:1788625065.005021:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021af31e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:7441:x1875509206064384:12345-0@lo:501: Request processed in 646us (6086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625065.005031:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788625065.007226:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a96dd81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206064384:0@lo:501: 00000100:00100000:1.0:1788625065.007289:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a96dd81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206064512:0@lo:503: 00000100:00100000:1.0:1788625065.007367:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625065.007413:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000004629dd57 going to sleep for 11 seconds 00000100:00100000:3.0:1788625065.007572:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206064512 00000100:00100000:3.0:1788625065.007580:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206064512 00000100:00100000:3.0:1788625065.007631:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788625065.007639:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e742adab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:7441:x1875509206064512:12345-0@lo:503: 00000040:00080000:3.0:1788625065.007700:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788625065.007748:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e742adab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:7441:x1875509206064512:12345-0@lo:503: Request processed in 110us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625065.007755:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788625065.007862:0:6516:0:(import.c:65:import_set_state_nolock()) 000000000e26e189 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625065.007921:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e06d1d08 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1875509206063616:12345-0@lo:38: Request processed in 13062us (16850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625065.007934:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625065.008068:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788625065.008076:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788625065.008082:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788625065.008093:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788625065.008095:0:3634:0:(import.c:65:import_set_state_nolock()) 00000000a2c407b7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788625065.008152:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000070246cb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206063616:0@lo:38: 00000100:00100000:1.0:1788625065.008636:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a96dd81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206064512:0@lo:503: 00000100:00100000:3.0:1788625065.008859:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d776827 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206064640:0@lo:41: 00000100:00100000:3.0:1788625065.008897:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788625065.008897:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625065.008963:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000100:00100000:0.0:1788625065.008977:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206064640 00000100:00100000:0.0:1788625065.008982:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206064640 00000100:00100000:0.0:1788625065.009017:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788625065.009023:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036b56cb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1875509206064640:12345-0@lo:41: 00000040:00080000:1.0:1788625065.009043:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000024:0.0:1788625065.009047:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788625065.009159:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036b56cb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1875509206064640:12345-0@lo:41: Request processed in 136us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625065.009175:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625065.009462:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d776827 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206064640:0@lo:41: 00000040:00080000:0.0:1788625065.014774:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1788625065.014963:0:7441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788625065.014999:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625065.015021:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79f70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f77 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625065.015036:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79f70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f77 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625065.015093:0:7441:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788625065.015110:0:7441:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99886c323000 10000000:01000000:2.0:1788625065.015113:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99886c323000 10000000:01000000:2.0:1788625065.015116:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788625065.015123:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99886c323000 from 1 10000000:01000000:2.0:1788625065.015125:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788625065.015159:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 00000000a376f74d/0x2d2e3b3f34a79f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625065.015167:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 00000000a376f74d/0x2d2e3b3f34a79f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625065.015176:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 00000000a376f74d/0x2d2e3b3f34a79f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625065.015212:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206064768:0@lo:101: 00000100:00100000:2.0:1788625065.015280:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625065.015322:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b270b5c going to sleep for 11 seconds 00000100:00100000:0.0:1788625065.015716:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206064768 00000100:00100000:0.0:1788625065.015724:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206064768 00000100:00100000:0.0:1788625065.015806:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788625065.015814:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9897d63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:7441:x1875509206064768:12345-0@lo:101: 00010000:00010000:0.0:1788625065.015826:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625065.015838:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79f85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79f7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.015861:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79f7e expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.015871:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002c073537/0x2d2e3b3f34a79f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79f7e expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.015879:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002c073537, rc 0) 00000100:00100000:0.0:1788625065.015921:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9897d63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:7441:x1875509206064768:12345-0@lo:101: Request processed in 108us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625065.015927:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788625065.016004:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206064768:0@lo:101: 00010000:00010000:2.0:1788625065.016021:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 00000000a376f74d/0x2d2e3b3f34a79f7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f85 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625065.016029:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 00000000a376f74d/0x2d2e3b3f34a79f7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79f85 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625065.016117:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206064896:0@lo:501: 00000100:00100000:2.0:1788625065.016142:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625065.016729:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b270b5c going to sleep for 11 seconds 00000100:00100000:3.0:1788625065.016794:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206064896 00000100:00100000:3.0:1788625065.016799:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206064896 00000100:00100000:3.0:1788625065.016827:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788625065.016833:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba58cd66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:7441:x1875509206064896:12345-0@lo:501: 00000100:00100000:3.0:1788625065.016988:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba58cd66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:7441:x1875509206064896:12345-0@lo:501: Request processed in 155us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625065.016997:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788625065.017129:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206064896:0@lo:501: 00000100:00100000:2.0:1788625065.017161:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206065024:0@lo:503: 00000100:00100000:2.0:1788625065.017480:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625065.017564:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b270b5c going to sleep for 11 seconds 00000100:00100000:3.0:1788625065.017680:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206065024 00000100:00100000:3.0:1788625065.017684:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206065024 00000100:00100000:3.0:1788625065.017749:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788625065.017756:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3478159 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:7441:x1875509206065024:12345-0@lo:503: 00000100:00100000:3.0:1788625065.017854:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3478159 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:7441:x1875509206065024:12345-0@lo:503: Request processed in 99us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625065.017861:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788625065.017924:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206065024:0@lo:503: 00000040:00080000:2.0:1788625065.018224:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788625065.018299:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206065152:0@lo:502: 00000100:00100000:2.0:1788625065.018344:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625065.018908:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef45349c going to sleep for 11 seconds 00000100:00100000:1.0:1788625065.018989:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206065152 00000100:00100000:1.0:1788625065.018996:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206065152 00000100:00100000:1.0:1788625065.019027:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788625065.019034:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8aac687 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:7441:x1875509206065152:12345-0@lo:502: 00000100:00100000:1.0:1788625065.019141:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8aac687 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:7441:x1875509206065152:12345-0@lo:502: Request processed in 108us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625065.019148:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788625065.019565:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206065152:0@lo:502: 00000040:00080000:2.0:1788625065.019777:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788625065.019807:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788625065.019822:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788625065.019836:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788625065.019850:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788625065.019864:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788625065.019878:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788625065.019891:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788625065.019904:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788625065.019918:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788625065.019934:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788625065.019949:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788625065.019961:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788625065.019972:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788625065.019983:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788625065.019995:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788625065.020009:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788625065.020023:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788625065.020038:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788625065.020050:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788625065.020063:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788625065.020076:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788625065.020102:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788625065.020117:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788625065.020130:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788625065.020143:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788625065.020162:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788625065.020177:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1788625065.020543:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206065280:0@lo:502: 00000100:00100000:2.0:1788625065.020597:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625065.020624:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef45349c going to sleep for 11 seconds 00000100:00100000:1.0:1788625065.020730:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206065280 00000100:00100000:1.0:1788625065.020738:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206065280 00000100:00100000:1.0:1788625065.020783:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788625065.020790:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccfc74b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:7441:x1875509206065280:12345-0@lo:502: 00000100:00100000:1.0:1788625065.020897:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccfc74b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:7441:x1875509206065280:12345-0@lo:502: Request processed in 108us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625065.020904:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788625065.021014:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206065280:0@lo:502: 00000040:00080000:2.0:1788625065.021065:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788625065.021075:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788625065.021826:0:7459:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788625065.021839:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000e042f8f1) 00000020:00000080:1.0:1788625065.021858:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788625065.021922:0:7459:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c90971d5 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788625065.021925:0:7459:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c90971d5 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788625065.021927:0:7459:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c90971d5 3 00010000:00080000:1.0:1788625065.021951:0:7459:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000034ca706e@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.114@tcp at head 00010000:00010000:1.0:1788625065.024730:0:7459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1788625065.024990:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788625065.025031:0:7459:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788625065.025043:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2d2e3b3f34a79f93 00000100:00080000:1.0:1788625065.025054:0:7459:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788625065.025058:0:7459:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000034ca706e using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625065.025093:0:7459:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005a96dd81 x1875509206065408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788625065.025119:0:7459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788625065.025715:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a96dd81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875509206065408:0@lo:38: 00000100:00100000:3.0:1788625065.025785:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625065.026072:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206065408 00000100:00100000:0.0:1788625065.026081:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206065408 00000100:00100000:0.0:1788625065.026118:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625065.026124:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a216aad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875509206065408:12345-0@lo:38: 00010000:00080000:0.0:1788625065.026148:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:0.0:1788625065.026190:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2d2e3b3f34a79f9a 00000004:00100000:0.0:1788625065.026204:0:6511:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788625065.026232:0:6511:0:(import.c:65:import_set_state_nolock()) 00000000363f0983 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625065.026304:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a216aad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875509206065408:12345-0@lo:38: Request processed in 179us (518us total) trans 0 rc 0/0 00010000:00080000:1.0:1788625065.026425:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005a96dd81 x1875509206065408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625065.026436:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788625065.026443:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788625065.026450:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788625065.026454:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788625065.026456:0:3634:0:(import.c:65:import_set_state_nolock()) 0000000034ca706e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788625065.026461:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a96dd81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875509206065408:0@lo:38: 00000100:00100000:0.0:1788625065.026598:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1788625065.026878:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:1.0:1788625065.027061:0:7460:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:0.0:1788625065.027135:0:7441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788625065.027167:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788625065.027195:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 00000000a376f74d/0x2d2e3b3f34a79f7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f85 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.027213:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 00000000a376f74d/0x2d2e3b3f34a79f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f85 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788625065.027481:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788625065.027484:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788625065.027485:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625065.027486:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625065.027488:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625065.027489:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625065.027490:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625065.027492:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788625065.027493:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788625065.027495:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625065.027496:0:7441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788625065.027499:0:7441:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788625065.027502:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788625065.027503:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788625065.027504:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625065.027505:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625065.027506:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625065.027507:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625065.027508:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625065.027509:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788625065.027510:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788625065.027511:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625065.027512:0:7441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788625065.027569:0:7441:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788625065.027583:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a8f1c70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206065536:0@lo:253: 00000100:00100000:0.0:1788625065.027654:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625065.027687:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000004be60bf0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625065.027769:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206065536 00000100:00100000:1.0:1788625065.027775:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206065536 00000100:00100000:1.0:1788625065.027812:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788625065.027820:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f828198 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:7441:x1875509206065536:12345-0@lo:253: 20000000:01000000:1.0:1788625065.027841:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788625065.027855:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788625065.035259:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788625065.035342:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788625065.035358:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788625065.035760:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f828198 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:7441:x1875509206065536:12345-0@lo:253: Request processed in 7938us (8103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625065.035774:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 20000000:01000000:1.0:1788625065.035861:0:6527:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788625065.035866:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788625065.035884:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000059fafd9d/0x2d2e3b3f34a79fa1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625065.035900:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005d90afa8/0x2d2e3b3f34a79ec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79eba expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625065.035907:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79f5b expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625065.035914:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000059fafd9d/0x2d2e3b3f34a79fa1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625065.035949:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a79f5b expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625065.035962:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79f62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f5b expref: 14 pid: 6506 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625065.035975:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a96dd81 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875509206065664:0@lo:104: 00000100:00100000:1.0:1788625065.036006:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788625065.036068:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005d90afa8/0x2d2e3b3f34a79ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a79eba expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625065.036076:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005d90afa8/0x2d2e3b3f34a79ec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79eba expref: 14 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625065.036083:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009139ef3b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875509206065792:0@lo:104: 00000100:00100000:1.0:1788625065.036103:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625065.036125:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 000000000f6a4013 going to sleep for 11 seconds 00000100:00100000:0.0:1788625065.036173:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206065664 00000100:00100000:0.0:1788625065.036192:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206065664 00000100:00100000:0.0:1788625065.036223:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206065792 00000100:00100000:0.0:1788625065.036225:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206065792 00000100:00100000:0.0:1788625065.036235:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625065.036250:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e02820b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:6527:x1875509206065664:12345-0@lo:104: 00010000:00010000:0.0:1788625065.036261:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79f62 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.036319:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788625065.036324:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e02820b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:6527:x1875509206065664:12345-0@lo:104: Request processed in 83us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625065.036329:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625065.036343:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788625065.036348:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000889eb9a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:6527:x1875509206065792:12345-0@lo:104: 00010000:00010000:0.0:1788625065.036354:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79ec1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.036384:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788625065.036388:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000889eb9a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:6527:x1875509206065792:12345-0@lo:104: Request processed in 42us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625065.036583:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788625065.036607:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788625065.036612:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79f62 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.036618:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098f58715 already unused, calling callback (0000000091cf9fbc) 10000000:00010000:0.0:1788625065.036622:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a79f62 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.036628:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a79f62 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625065.036635:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a79f62 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625065.036640:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625065.036668:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79f5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79f62 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.036674:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625065.036691:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79f5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79f62 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.036696:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: 0000000098f58715/0x2d2e3b3f34a79f5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79f62 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.036709:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625065.036711:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79ec1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.036717:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000da3adff8 already unused, calling callback (0000000091cf9fbc) 10000000:00010000:0.0:1788625065.036718:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a79ec1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.036730:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a79ec1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625065.036736:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a79ec1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625065.036741:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625065.036752:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79eba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79ec1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.036757:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625065.036761:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79eba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79ec1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.036767:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79eba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79ec1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.036778:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625065.036779:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625065.036781:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625065.036787:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625065.036804:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cbe931f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206065920:0@lo:103: 00000100:00100000:0.0:1788625065.036832:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625065.036851:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625065.036856:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa99f842 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206066048:0@lo:103: 00000100:00100000:0.0:1788625065.036877:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625065.036902:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206065920 00000100:00100000:0.0:1788625065.036906:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206065920 00010000:00010000:0.0:1788625065.036922:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79f62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f5b expref: 15 pid: 6506 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625065.036946:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206066048 00000100:00100000:0.0:1788625065.036949:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206066048 00010000:00010000:0.0:1788625065.036957:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005d90afa8/0x2d2e3b3f34a79ec1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79eba expref: 16 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625065.036966:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625065.036970:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e6b8165 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:3635:x1875509206065920:12345-0@lo:103: 00010000:00010000:0.0:1788625065.036979:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625065.036982:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79f62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f5b expref: 16 pid: 6506 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.036989:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79f62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f5b expref: 16 pid: 6506 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.037002:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625065.037026:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e6b8165 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:3635:x1875509206065920:12345-0@lo:103: Request processed in 55us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625065.037031:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625065.037042:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788625065.037046:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081fe72e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:3635:x1875509206066048:12345-0@lo:103: 00010000:00010000:0.0:1788625065.037051:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625065.037054:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005d90afa8/0x2d2e3b3f34a79ec1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79eba expref: 15 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.037061:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005d90afa8/0x2d2e3b3f34a79ec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79eba expref: 15 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.037070:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000059fafd9d/0x2d2e3b3f34a79fa1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.037082:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000059fafd9d/0x2d2e3b3f34a79fa1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788625065.037094:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001229815s 00010000:00010000:0.0:1788625065.037098:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000059fafd9d/0x2d2e3b3f34a79fa1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.037103:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000059fafd9d/0x2d2e3b3f34a79fa1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.037109:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000059fafd9d/0x2d2e3b3f34a79fa1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.037114:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000059fafd9d/0x2d2e3b3f34a79fa1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.037119:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000059fafd9d already unused, calling callback (0000000055fa61c0) 00010000:00010000:0.0:1788625065.037122:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000059fafd9d/0x2d2e3b3f34a79fa1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.037128:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000059fafd9d/0x2d2e3b3f34a79fa1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.037135:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000059fafd9d/0x2d2e3b3f34a79fa1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625065.037144:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625065.037166:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081fe72e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:3635:x1875509206066048:12345-0@lo:103: Request processed in 120us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625065.037172:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788625065.037467:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000047900784/0x2d2e3b3f34a79f62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f5b expref: 14 pid: 6506 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625065.037477:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a96dd81 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875509206065664:0@lo:104: 00010000:00010000:1.0:1788625065.037486:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005d90afa8/0x2d2e3b3f34a79ec1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a79eba expref: 13 pid: 6505 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625065.037494:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009139ef3b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875509206065792:0@lo:104: 00010000:00010000:1.0:1788625065.037510:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000059fafd9d/0x2d2e3b3f34a79fa1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625065.037534:0:6527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000059fafd9d/0x2d2e3b3f34a79fa1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625065.037539:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000059fafd9d/0x2d2e3b3f34a79fa1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625065.037545:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000059fafd9d/0x2d2e3b3f34a79fa1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625065.037792:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a8f1c70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:7441:1875509206065536:0@lo:253: 10000000:01000000:3.0:1788625065.037802:0:7441:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788625065.037811:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788625065.037813:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788625065.037814:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625065.037815:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625065.037817:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625065.037818:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625065.037819:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788625065.037821:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788625065.037822:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788625065.037823:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625065.037825:0:7441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788625065.037837:0:7441:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788625065.039755:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa99f842 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206066048:0@lo:103: 00000100:00100000:0.0:1788625065.039769:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cbe931f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206065920:0@lo:103: 00010000:00010000:1.0:1788625065.040147:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788625065.050562:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1788625065.050740:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788625065.050973:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788625065.051144:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788625065.051347:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788625065.054617:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788625065.055921:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788625065.063937:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788625065.064965:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1788625065.065169:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788625065.065902:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1788625065.066113:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1788625065.071388:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1788625065.071961:0:7465:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1788625065.072017:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009139ef3b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7465:1875509206066176:0@lo:700: 00000100:00100000:1.0:1788625065.072083:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625065.072136:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000090686209 going to sleep for 11 seconds 00000040:01000000:2.0:1788625065.072197:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788625065.072779:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875509206066304:0@lo:1000: 00000100:00100000:2.0:1788625065.072818:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625065.072849:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206066304 00000100:00100000:2.0:1788625065.072856:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206066304 00000100:00100000:2.0:1788625065.072900:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625065.072909:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048e2d543 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875509206066304:12345-0@lo:1000: 00000100:00100000:2.0:1788625065.072977:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048e2d543 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875509206066304:12345-0@lo:1000: Request processed in 70us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625065.072985:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625065.073012:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000005bcc4528 going to sleep for 11 seconds 00000100:00100000:2.0:1788625065.073033:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875509206066304:0@lo:1000: 00000040:01000000:2.0:1788625065.073062:0:7466:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788625065.073083:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875509206066432:0@lo:700: 00000100:00100000:2.0:1788625065.073106:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625065.073137:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d15d9ad going to sleep for 11 seconds 00000040:01000000:1.0:1788625065.074127:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:2.0:1788625065.074378:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206066432 00000100:00100000:2.0:1788625065.074386:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206066432 00000100:00100000:2.0:1788625065.074587:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625065.074595:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5103088 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875509206066432:12345-0@lo:700: 00000100:00100000:2.0:1788625065.074658:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5103088 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875509206066432:12345-0@lo:700: Request processed in 65us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625065.074664:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625065.074700:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875509206066432:0@lo:700: 00000100:00100000:2.0:1788625065.074751:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7466:1875509206066560:0@lo:900: 00000100:00100000:2.0:1788625065.074794:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625065.074820:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d15d9ad going to sleep for 11 seconds 00000100:00100000:1.0:1788625065.074988:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206066560 00000100:00100000:1.0:1788625065.074993:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206066560 00000100:00100000:1.0:1788625065.075039:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788625065.075044:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa99d694 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1875509206066560:12345-0@lo:900: 00000100:00100000:1.0:1788625065.075082:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa99d694 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1875509206066560:12345-0@lo:900: Request processed in 38us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625065.075087:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1788625065.075133:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788625065.077973:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206066176 00000100:00100000:0.0:1788625065.077986:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206066176 00000100:00100000:0.0:1788625065.078045:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625065.078053:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a96dd81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7465:x1875509206066176:12345-0@lo:700: 00010000:00080000:2.0:1788625065.078510:0:7466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000059628342 x1875509206066560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788625081 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625065.078544:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7466:1875509206066560:0@lo:900: 00000100:00100000:2.0:1788625065.078645:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875509206066688:0@lo:1000: 00000100:00100000:2.0:1788625065.078705:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625065.078755:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f67ad73b going to sleep for 11 seconds 00000100:00100000:0.0:1788625065.079144:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206066688 00000100:00100000:0.0:1788625065.079151:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206066688 00000100:00100000:0.0:1788625065.079209:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625065.079217:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c68e1d79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875509206066688:12345-0@lo:1000: 00000100:00100000:0.0:1788625065.079297:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c68e1d79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875509206066688:12345-0@lo:1000: Request processed in 81us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625065.079304:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00000080:1.0:1788625065.079645:0:7441:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788625065.079660:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788625065.079938:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788625065.081064:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875509206066688:0@lo:1000: 00000004:00080000:2.0:1788625065.081126:0:7466:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000001d15d9ad with version 0 00000020:00100000:2.0:1788625065.081150:0:7466:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788625065.081156:0:7466:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000059628342 x1875509206066944/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788625065.081174:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875509206066944:0@lo:1000: 00000100:00100000:2.0:1788625065.081376:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625065.081550:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000001a6519de going to sleep for 11 seconds 00000100:00100000:0.0:1788625065.081653:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206066944 00000100:00100000:0.0:1788625065.081661:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206066944 00000100:00100000:0.0:1788625065.081703:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625065.081710:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e85635d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875509206066944:12345-0@lo:1000: 00000020:00080000:3.0:1788625065.082236:0:7464:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788625065.082251:0:7464:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:1.0:1788625065.084198:0:7441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788625065.086261:0:7441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788625065.086327:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788625065.086632:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788625065.086845:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788625065.087424:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788625065.087651:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788625065.087790:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788625065.087923:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788625065.088098:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788625065.088311:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00000001:00080000:3.0:1788625065.091620:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:0.0:1788625065.091709:0:6518:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:1.0:1788625065.095954:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788625065.096664:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788625065.096827:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788625065.096954:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788625065.097079:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000100:00100000:2.0:1788625065.097699:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e85635d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875509206066944:12345-0@lo:1000: Request processed in 15985us (16385us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788625065.097712:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1788625065.099192:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788625065.099209:0:7466:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788625065.099232:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059628342 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875509206066944:0@lo:1000: 00000100:00100000:3.0:1788625065.099576:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036e24624 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875509206067072:0@lo:1000: 00000100:00100000:3.0:1788625065.099634:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625065.099697:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010e0903e going to sleep for 11 seconds 00000100:00100000:2.0:1788625065.099771:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206067072 00000100:00100000:2.0:1788625065.099779:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206067072 00000100:00100000:2.0:1788625065.099835:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788625065.099843:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000287134f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1875509206067072:12345-0@lo:1000: 00000100:00100000:2.0:1788625065.099922:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000287134f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1875509206067072:12345-0@lo:1000: Request processed in 81us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625065.099930:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788625065.099959:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036e24624 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875509206067072:0@lo:1000: 00000040:00080000:2.0:1788625065.099976:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788625065.100003:0:7466:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000a5bd6826 with version 1 00100000:10000000:1.0:1788625065.101626:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788625065.101880:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788625065.102048:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788625065.102217:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00000100:00100000:0.0:1788625065.104927:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a96dd81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7465:x1875509206066176:12345-0@lo:700: Request processed in 26867us (32836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625065.104942:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788625065.105039:0:7465:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009139ef3b x1875509206066176/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788625081 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625065.105053:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009139ef3b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7465:1875509206066176:0@lo:700: 40000000:02000000:0.0:1788625065.105068:0:7465:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:1.0:1788625065.107003:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000040:00080000:2.0:1788625065.112804:0:7466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00100000:10000000:1.0:1788625065.112920:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788625065.113191:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788625065.114848:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788625065.115093:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000004:00080000:2.0:1788625065.115583:0:7466:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788625065.115705:0:7456:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000f4fcdcf0 version 1 rpc_version 1 00000020:00100000:2.0:1788625065.115737:0:7456:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788625065.115746:0:7456:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e63850c5 x1875509206067328/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788625065.115768:0:7456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e63850c5 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7456:1875509206067328:0@lo:1000: 00000100:00100000:2.0:1788625065.115832:0:7456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625065.115889:0:7456:0:(client.c:2716:ptlrpc_set_wait()) set 000000009681667f going to sleep for 11 seconds 00000100:00100000:3.0:1788625065.115970:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206067328 00000100:00100000:3.0:1788625065.115978:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206067328 00000100:00100000:3.0:1788625065.116028:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625065.116036:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059628342 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7456:x1875509206067328:12345-0@lo:1000: 00100000:10000000:1.0:1788625065.117995:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788625065.118294:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788625065.120560:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788625065.120739:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788625065.120878:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788625065.121015:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788625065.121150:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788625065.121335:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788625065.125004:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788625065.130274:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788625065.130732:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788625065.130893:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788625065.131136:0:7441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788625065.134862:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1788625065.135108:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059628342 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7456:x1875509206067328:12345-0@lo:1000: Request processed in 19070us (19273us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788625065.135122:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1788625065.135376:0:7456:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788625065.135381:0:7456:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788625065.135460:0:7456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e63850c5 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7456:1875509206067328:0@lo:1000: 00000001:00080000:1.0:1788625065.154275:0:7441:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788625065.154432:0:7441:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa6ab0192b988 00100000:10000000:1.0:1788625065.154442:0:7441:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788625065.155070:0:7441:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788625065.155465:0:7441:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788625065.155486:0:7441:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788625065.155511:0:7441:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788625065.157213:0:7441:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625065.158699:0:7441:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1788625065.163227:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625065.183349:0:7465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788625065.183447:0:7465:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788625065.183453:0:7465:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788625066.064792:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625067.084367:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625068.110763:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625069.140361:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788625069.603929:0:7710:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788625070.160498:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625070.347863:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625070.347920:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625070.347950:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa99f842 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206067584:0@lo:400: 00000100:00100000:1.0:1788625070.348018:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625070.348149:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206067584 00000100:00100000:2.0:1788625070.348157:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206067584 00000100:00100000:2.0:1788625070.348214:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788625070.348223:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000da37011 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206067584:12345-0@lo:400: 00000100:00100000:2.0:1788625070.348277:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000da37011 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206067584:12345-0@lo:400: Request processed in 56us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625070.348286:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788625070.348322:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000fa99f842 x1875509206067584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625070.348334:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa99f842 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206067584:0@lo:400: 00000100:00100000:3.0:1788625070.350047:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cbe931f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206067456:0@lo:400: 00000100:00100000:0.0:1788625070.350111:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2e874b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206067712:0@lo:400: 00000100:00100000:3.0:1788625070.350126:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625070.350170:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625070.350193:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206067456 00000100:00100000:1.0:1788625070.350204:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206067456 00000100:00100000:0.0:1788625070.350215:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625070.350223:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e6b8165 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206067840:0@lo:400: 00000100:00100000:1.0:1788625070.350251:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788625070.350257:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625070.350265:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000228ac879 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+13:3638:x1875509206067456:12345-0@lo:400: 00000100:00100000:0.0:1788625070.350302:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206067712 00000100:00100000:0.0:1788625070.350307:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206067712 00000100:00100000:1.0:1788625070.350319:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000228ac879 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+13:3638:x1875509206067456:12345-0@lo:400: Request processed in 57us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625070.350327:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788625070.350342:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788625070.350352:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a415983 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206067712:12345-0@lo:400: 00000100:00100000:0.0:1788625070.350494:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a415983 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206067712:12345-0@lo:400: Request processed in 145us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625070.350501:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788625070.350567:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cbe931f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206067456:0@lo:400: 00000100:00100000:3.0:1788625070.350647:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206067840 00000100:00100000:3.0:1788625070.350651:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206067840 00000100:00100000:3.0:1788625070.350676:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625070.350681:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd4f065f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206067840:12345-0@lo:400: 00000100:00100000:3.0:1788625070.350711:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd4f065f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206067840:12345-0@lo:400: Request processed in 31us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625070.350717:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625070.350733:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625070.350740:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e47ea04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206067968:0@lo:41: 00000100:00100000:3.0:1788625070.350762:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625070.350787:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206067968 00000100:00100000:3.0:1788625070.350791:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206067968 00000100:00100000:3.0:1788625070.351020:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625070.351027:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000049768ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206067968:12345-0@lo:41: 00000004:00000024:3.0:1788625070.351133:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788625070.351236:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000049768ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206067968:12345-0@lo:41: Request processed in 209us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625070.351243:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625070.351796:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e47ea04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206067968:0@lo:41: 00000100:00100000:1.0:1788625070.352488:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2e874b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206067712:0@lo:400: 00010000:00080000:0.0:1788625070.352688:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009e6b8165 x1875509206067840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625070.352700:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e6b8165 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206067840:0@lo:400: 00000020:00000004:1.0:1788625070.519965:0:7762:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788625070.520339:0:7762:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788625071.181504:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625072.205406:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788625073.110983:0:7864:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788625073.111617:0:7864:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788625073.227964:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788625073.932630:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788625073.932639:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99886c323000 from 4 10000000:01000000:0.0:1788625073.932644:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788625073.932687:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625073.932706:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625073.932717:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625073.932740:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e6b8165 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206068096:0@lo:101: 00000100:00100000:0.0:1788625073.932802:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625073.932853:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 000000008460000d going to sleep for 11 seconds 00000100:00100000:1.0:1788625073.933168:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206068096 00000100:00100000:1.0:1788625073.933177:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206068096 00000100:00100000:1.0:1788625073.933312:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788625073.933321:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3773c65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+13:6508:x1875509206068096:12345-0@lo:101: 00010000:00010000:1.0:1788625073.933335:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625073.933348:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ba6f21a/0x2d2e3b3f34a79faf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79fa8 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625073.933369:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ba6f21a/0x2d2e3b3f34a79faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79fa8 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625073.933377:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ba6f21a/0x2d2e3b3f34a79faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79fa8 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625073.933384:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ba6f21a, rc 0) 00000100:00100000:1.0:1788625073.933467:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3773c65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:6508:x1875509206068096:12345-0@lo:101: Request processed in 148us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625073.933474:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788625073.936507:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e6b8165 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206068096:0@lo:101: 00010000:00010000:3.0:1788625073.936549:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79fa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625073.936678:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79fa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625073.936753:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000076dae39c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206068224:0@lo:256: 00000100:00100000:3.0:1788625073.936818:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625073.936866:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 000000007e5f9f35 going to sleep for 11 seconds 00000100:00100000:3.0:1788625073.936893:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206068224 00000100:00100000:3.0:1788625073.936899:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206068224 00000100:00100000:3.0:1788625073.936940:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788625073.936948:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccacec73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:6508:x1875509206068224:12345-0@lo:256: 20000000:01000000:3.0:1788625073.936966:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788625073.936982:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788625073.936985:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788625073.937086:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccacec73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:6508:x1875509206068224:12345-0@lo:256: Request processed in 139us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625073.937094:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788625073.937126:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000076dae39c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206068224:0@lo:256: 10000000:01000000:2.0:1788625073.937166:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788625073.937173:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79fa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625073.937181:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 00000000e154ef63/0x2d2e3b3f34a79fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625073.937189:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788625073.937191:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998852348000 from 21 10000000:01000000:2.0:1788625073.937194:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788625073.937214:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 0000000047900784/0x2d2e3b3f34a79fb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625073.937220:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 0000000047900784/0x2d2e3b3f34a79fb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625073.937291:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 0000000047900784/0x2d2e3b3f34a79fb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625073.937302:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e63850c5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206068352:0@lo:101: 00000100:00100000:2.0:1788625073.937328:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625073.937342:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b03a2216 going to sleep for 11 seconds 00000100:00100000:2.0:1788625073.937354:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206068352 00000100:00100000:2.0:1788625073.937358:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206068352 00000100:00100000:2.0:1788625073.937377:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788625073.937382:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b77c7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:6508:x1875509206068352:12345-0@lo:101: 00010000:00010000:2.0:1788625073.937390:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625073.937399:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000098f58715/0x2d2e3b3f34a79fbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79fb6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625073.937416:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098f58715/0x2d2e3b3f34a79fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79fb6 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625073.937423:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000098f58715/0x2d2e3b3f34a79fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79fb6 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625073.937429:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000098f58715, rc 0) 00000100:00100000:2.0:1788625073.937452:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b77c7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:6508:x1875509206068352:12345-0@lo:101: Request processed in 70us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625073.937457:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788625073.937481:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e63850c5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206068352:0@lo:101: 00010000:00010000:2.0:1788625073.937490:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 0000000047900784/0x2d2e3b3f34a79fb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625073.937506:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 0000000047900784/0x2d2e3b3f34a79fb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625073.937582:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e63850c5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206068480:0@lo:501: 00000100:00100000:2.0:1788625073.937604:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625073.937615:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b03a2216 going to sleep for 11 seconds 00000100:00100000:2.0:1788625073.937625:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206068480 00000100:00100000:2.0:1788625073.937628:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206068480 00000100:00100000:2.0:1788625073.937641:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788625073.937646:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072ad78b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:6508:x1875509206068480:12345-0@lo:501: 00000100:00100000:2.0:1788625073.937754:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072ad78b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:6508:x1875509206068480:12345-0@lo:501: Request processed in 107us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625073.937761:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788625073.937790:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e63850c5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206068480:0@lo:501: 00000100:00100000:2.0:1788625073.937815:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e63850c5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206068608:0@lo:503: 00000100:00100000:2.0:1788625073.937851:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625073.937863:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b03a2216 going to sleep for 11 seconds 00000100:00100000:2.0:1788625073.937874:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206068608 00000100:00100000:2.0:1788625073.937877:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206068608 00000100:00100000:2.0:1788625073.937892:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788625073.937897:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000752e85ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:6508:x1875509206068608:12345-0@lo:503: 00000100:00100000:2.0:1788625073.937974:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000752e85ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:6508:x1875509206068608:12345-0@lo:503: Request processed in 77us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625073.937981:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788625073.938032:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e63850c5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206068608:0@lo:503: 00000100:00100000:0.0:1788625073.938717:0:7903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003cdae550 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:7903:1875509206068736:0@lo:502: 00000100:00100000:0.0:1788625073.938764:0:7903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625073.938825:0:7903:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0a3c14a going to sleep for 11 seconds 00000100:00100000:2.0:1788625073.938854:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206068736 00000100:00100000:2.0:1788625073.938858:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206068736 00000100:00100000:2.0:1788625073.938913:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788625073.938918:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054a4dbb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:7903:x1875509206068736:12345-0@lo:502: 00000100:00100000:2.0:1788625073.939015:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054a4dbb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:7903:x1875509206068736:12345-0@lo:502: Request processed in 97us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625073.939023:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788625073.939093:0:7903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003cdae550 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:7903:1875509206068736:0@lo:502: 00000100:00100000:1.0:1788625073.939133:0:7903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e4b6438 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:7903:1875509206068864:0@lo:502: 00000100:00100000:1.0:1788625073.939161:0:7903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625073.939369:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206068864 00000100:00100000:0.0:1788625073.939373:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206068864 00000100:00100000:0.0:1788625073.939393:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788625073.939397:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d536701b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:7903:x1875509206068864:12345-0@lo:502: 00000100:00100000:0.0:1788625073.939458:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d536701b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:7903:x1875509206068864:12345-0@lo:502: Request processed in 60us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625073.939463:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788625073.939598:0:7903:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005b1f723 going to sleep for 11 seconds 00000100:00100000:0.0:1788625073.939612:0:7903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e4b6438 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:7903:1875509206068864:0@lo:502: 00000040:00080000:0.0:1788625073.939629:0:7903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788625073.939774:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788625073.939793:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788625073.939802:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 0000000047900784/0x2d2e3b3f34a79fb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625073.939811:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 0000000047900784/0x2d2e3b3f34a79fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625073.939819:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788625073.939821:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998852348000 from 4 10000000:01000000:2.0:1788625073.939824:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788625073.939845:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625073.939852:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625073.939860:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625073.939872:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e63850c5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206068992:0@lo:101: 00000100:00100000:2.0:1788625073.939900:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625073.939931:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 0000000030faf41b going to sleep for 11 seconds 00000100:00100000:0.0:1788625073.940143:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206068992 00000100:00100000:0.0:1788625073.940148:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206068992 00000100:00100000:0.0:1788625073.940183:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788625073.940188:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c7416fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:6508:x1875509206068992:12345-0@lo:101: 00010000:00010000:0.0:1788625073.940205:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625073.940216:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e722bd81/0x2d2e3b3f34a79fcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79fc4 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625073.940246:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e722bd81/0x2d2e3b3f34a79fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79fc4 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625073.940254:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e722bd81/0x2d2e3b3f34a79fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79fc4 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625073.940261:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e722bd81, rc 0) 00000100:00100000:0.0:1788625073.940288:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c7416fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206068992:12345-0@lo:101: Request processed in 101us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625073.940293:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788625073.940319:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e63850c5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206068992:0@lo:101: 00010000:00010000:0.0:1788625073.940329:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625073.940335:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625073.940371:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b69b8cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206069120:0@lo:256: 00000100:00100000:0.0:1788625073.940396:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625073.940407:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af441d98 going to sleep for 11 seconds 00000100:00100000:0.0:1788625073.940416:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206069120 00000100:00100000:0.0:1788625073.940419:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206069120 00000100:00100000:0.0:1788625073.940432:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788625073.940436:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000ea6b74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206069120:12345-0@lo:256: 20000000:01000000:0.0:1788625073.940452:0:6503:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788625073.940464:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788625073.940466:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788625073.940545:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000ea6b74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206069120:12345-0@lo:256: Request processed in 108us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625073.940551:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788625073.940575:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b69b8cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206069120:0@lo:256: 10000000:01000000:0.0:1788625073.940610:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788625073.940614:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625073.940619:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 00000000da3adff8/0x2d2e3b3f34a79fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625073.940625:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788625073.940626:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788625073.940628:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788625073.940650:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 000000002d62758e/0x2d2e3b3f34a79fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625073.940657:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 000000002d62758e/0x2d2e3b3f34a79fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625073.940663:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 000000002d62758e/0x2d2e3b3f34a79fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625073.940674:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b69b8cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206069248:0@lo:101: 00000100:00100000:0.0:1788625073.940697:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625073.940709:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af441d98 going to sleep for 11 seconds 00000100:00100000:0.0:1788625073.940726:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206069248 00000100:00100000:0.0:1788625073.940729:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206069248 00000100:00100000:0.0:1788625073.940744:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788625073.940749:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf54068c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206069248:12345-0@lo:101: 00010000:00010000:0.0:1788625073.940754:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625073.940761:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2dfa3f1/0x2d2e3b3f34a79fd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79fd2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625073.940773:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2dfa3f1/0x2d2e3b3f34a79fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79fd2 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625073.940780:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2dfa3f1/0x2d2e3b3f34a79fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79fd2 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625073.940786:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2dfa3f1, rc 0) 00000100:00100000:0.0:1788625073.940808:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf54068c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206069248:12345-0@lo:101: Request processed in 59us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625073.940812:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788625073.940835:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b69b8cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206069248:0@lo:101: 00010000:00010000:0.0:1788625073.940844:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 000000002d62758e/0x2d2e3b3f34a79fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625073.940849:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 000000002d62758e/0x2d2e3b3f34a79fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625073.940884:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b69b8cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206069376:0@lo:501: 00000100:00100000:0.0:1788625073.940902:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625073.940912:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f465db0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625073.940921:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206069376 00000100:00100000:0.0:1788625073.940928:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206069376 00000100:00100000:0.0:1788625073.940943:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788625073.940946:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efbcfec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206069376:12345-0@lo:501: 00000100:00100000:0.0:1788625073.941044:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efbcfec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206069376:12345-0@lo:501: Request processed in 97us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625073.941051:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788625073.941086:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b69b8cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206069376:0@lo:501: 00000100:00100000:0.0:1788625073.941106:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b69b8cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206069504:0@lo:503: 00000100:00100000:0.0:1788625073.941135:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625073.941146:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f465db0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625073.941156:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206069504 00000100:00100000:0.0:1788625073.941158:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206069504 00000100:00100000:0.0:1788625073.941171:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788625073.941175:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a5e3490 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206069504:12345-0@lo:503: 00000100:00100000:0.0:1788625073.941232:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a5e3490 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206069504:12345-0@lo:503: Request processed in 56us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625073.941238:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788625073.941267:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b69b8cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206069504:0@lo:503: 00000100:00100000:0.0:1788625073.941417:0:7904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b69b8cd pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:7904:1875509206069632:0@lo:502: 00000100:00100000:0.0:1788625073.941445:0:7904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625073.941459:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206069632 00000100:00100000:0.0:1788625073.941462:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206069632 00000100:00100000:0.0:1788625073.941475:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788625073.941479:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000055a375c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:7904:x1875509206069632:12345-0@lo:502: 00000100:00100000:0.0:1788625073.941553:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000055a375c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:7904:x1875509206069632:12345-0@lo:502: Request processed in 73us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625073.941566:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788625073.941590:0:7904:0:(client.c:2716:ptlrpc_set_wait()) set 000000000cff855d going to sleep for 11 seconds 00000100:00100000:0.0:1788625073.941600:0:7904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b69b8cd pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:7904:1875509206069632:0@lo:502: 00000020:01000000:0.0:1788625073.941617:0:7904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625073.941625:0:7904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625073.941627:0:7904:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788625073.941631:0:7904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788625073.941633:0:7904:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:00000080:0.0:1788625073.941654:0:7904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625073.941667:0:7904:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000001730578b) 00000020:00000080:0.0:1788625073.941685:0:7904:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1788625073.941690:0:7904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788625073.941767:0:7904:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788625073.941772:0:7904:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788625073.941779:0:7904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a79fe7 00010000:00080000:0.0:1788625073.941804:0:7904:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000022464bd8@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.114@tcp at head 00010000:00010000:0.0:1788625073.946815:0:7904:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788625073.948463:0:7904:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788625073.948478:0:7904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788625073.948509:0:7904:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788625073.948558:0:7904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a79fee 00000100:00080000:1.0:1788625073.948568:0:7904:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788625073.948574:0:7904:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000022464bd8 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625073.948612:0:7904:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f5f997c0 x1875509206069760/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788625073.948643:0:7904:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788625073.948737:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005affc7c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206069888:0@lo:400: 00000100:00100000:1.0:1788625073.948799:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625073.948841:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088e79da4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206070016:0@lo:400: 00000100:00100000:1.0:1788625073.948866:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625073.948880:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625073.948884:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f61fe308 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206070144:0@lo:400: 00000100:00100000:1.0:1788625073.948899:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625073.948921:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206069888 00000100:00100000:1.0:1788625073.948926:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206069888 00000100:00100000:1.0:1788625073.948958:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206070144 00000100:00100000:1.0:1788625073.948960:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206070144 00000100:00100000:1.0:1788625073.948972:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625073.948978:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e4b6438 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206069888:12345-0@lo:400: 00000100:00100000:1.0:1788625073.949037:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e4b6438 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206069888:12345-0@lo:400: Request processed in 59us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625073.949044:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625073.949058:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625073.949166:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5f997c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206069760:0@lo:38: 00000100:00100000:2.0:1788625073.949196:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625073.949318:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066d922ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206070144:12345-0@lo:400: 00000100:00100000:1.0:1788625073.949357:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066d922ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206070144:12345-0@lo:400: Request processed in 295us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625073.949363:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788625073.949419:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f61fe308 x1875509206070144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625073.949432:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f61fe308 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206070144:0@lo:400: 00000040:01000000:0.0:1788625073.949874:0:7904:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1788625073.950021:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206070016 00000100:00100000:1.0:1788625073.950027:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206070016 00000100:00100000:1.0:1788625073.950051:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206069760 00000100:00100000:1.0:1788625073.950054:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206069760 00000100:00100000:1.0:1788625073.950142:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625073.950147:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009139ef3b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206070016:12345-0@lo:400: 00000100:00100000:1.0:1788625073.950294:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009139ef3b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206070016:12345-0@lo:400: Request processed in 147us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625073.950300:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625073.950311:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625073.950315:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062dbf826 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875509206069760:12345-0@lo:38: 00010000:00080000:1.0:1788625073.950334:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1788625073.950362:0:6516:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a79ff5 00000004:00100000:1.0:1788625073.950375:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788625073.950380:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788625073.950431:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088e79da4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206070016:0@lo:400: 00010000:00080000:1.0:1788625073.950456:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005affc7c5 x1875509206069888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625073.950466:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005affc7c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206069888:0@lo:400: 00000020:01000000:0.0:1788625073.950608:0:7904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625073.950615:0:7904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625073.950617:0:7904:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788625073.950620:0:7904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00080000:2.0:1788625073.950623:0:7908:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000007a6d17 x1875509206070272/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000020:00000080:0.0:1788625073.950626:0:7904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625073.950629:0:7904:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788625073.950635:0:7904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788625073.950638:0:7904:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788625073.950641:0:7908:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9e8ee3f going to sleep for 0 seconds 00000100:00100000:0.0:1788625073.950669:0:7904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b69b8cd pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:7904:1875509206070400:0@lo:502: 00000100:00100000:0.0:1788625073.950715:0:7904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625073.950736:0:7904:0:(client.c:2716:ptlrpc_set_wait()) set 00000000951edefd going to sleep for 11 seconds 00000100:00100000:1.0:1788625073.950785:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206070400 00000100:00100000:1.0:1788625073.950789:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206070400 00000100:00100000:1.0:1788625073.950824:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788625073.950829:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4cad16a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:7904:x1875509206070400:12345-0@lo:502: 00000100:00100000:1.0:1788625073.950954:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4cad16a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:7904:x1875509206070400:12345-0@lo:502: Request processed in 125us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625073.950961:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788625073.951732:0:7904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b69b8cd pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:7904:1875509206070400:0@lo:502: 00000020:01000000:0.0:1788625073.951759:0:7904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625073.951765:0:7904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625073.951767:0:7904:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788625073.951770:0:7904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788625073.953382:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788625073.953414:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788625073.953422:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 000000002d62758e/0x2d2e3b3f34a79fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625073.953444:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 000000002d62758e/0x2d2e3b3f34a79fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625073.955594:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788625073.955600:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99885ecd99c0 from 1 10000000:01000000:0.0:1788625073.955605:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788625073.955642:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 00000000c5c4b233/0x2d2e3b3f34a79ffc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625073.955654:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 00000000c5c4b233/0x2d2e3b3f34a79ffc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625073.955664:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 00000000c5c4b233/0x2d2e3b3f34a79ffc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625073.955686:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b69b8cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206070528:0@lo:101: 00000100:00100000:0.0:1788625073.955751:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625073.955784:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000951edefd going to sleep for 11 seconds 00000100:00100000:1.0:1788625073.955995:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206070528 00000100:00100000:1.0:1788625073.956012:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206070528 00000100:00100000:1.0:1788625073.956071:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788625073.956080:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cbddb65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206070528:12345-0@lo:101: 00010000:00010000:1.0:1788625073.956094:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625073.956106:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b022a44d/0x2d2e3b3f34a7a003 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a79ffc expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625073.956128:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b022a44d/0x2d2e3b3f34a7a003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79ffc expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625073.956138:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b022a44d/0x2d2e3b3f34a7a003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79ffc expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625073.956146:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b022a44d, rc 0) 00000100:00100000:1.0:1788625073.956185:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cbddb65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206070528:12345-0@lo:101: Request processed in 107us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625073.956191:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788625073.956225:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b69b8cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206070528:0@lo:101: 00010000:00010000:1.0:1788625073.956248:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 00000000c5c4b233/0x2d2e3b3f34a79ffc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a003 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625073.956256:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 00000000c5c4b233/0x2d2e3b3f34a79ffc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a003 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625073.956331:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005affc7c5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206070656:0@lo:501: 00000100:00100000:1.0:1788625073.956356:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625073.956371:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef45349c going to sleep for 11 seconds 00000100:00100000:1.0:1788625073.956384:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206070656 00000100:00100000:1.0:1788625073.956387:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206070656 00000100:00100000:1.0:1788625073.956402:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788625073.956406:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2ef4f85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206070656:12345-0@lo:501: 00000100:00100000:1.0:1788625073.956480:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2ef4f85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206070656:12345-0@lo:501: Request processed in 73us (123us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788625073.956486:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788625073.956511:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005affc7c5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206070656:0@lo:501: 10000000:01000000:1.0:1788625073.956568:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788625073.956575:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: 00000000c5c4b233/0x2d2e3b3f34a79ffc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a003 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625073.956582:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: 00000000c5c4b233/0x2d2e3b3f34a79ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a003 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788625073.968765:0:6516:0:(import.c:65:import_set_state_nolock()) 00000000bdbd9788 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625073.968866:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062dbf826 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1875509206069760:12345-0@lo:38: Request processed in 18547us (19666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625073.968878:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625073.968904:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788625073.968914:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788625073.968922:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788625073.968927:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788625073.968929:0:3634:0:(import.c:65:import_set_state_nolock()) 0000000022464bd8 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788625073.968947:0:3634:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f9e8ee3f): req@00000000007a6d17 x1875509206070272/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625073.968978:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5f997c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206069760:0@lo:38: 00000100:00100000:3.0:1788625073.969750:0:7908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625073.969807:0:7908:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9e8ee3f going to sleep for 11 seconds 00000100:00100000:3.0:1788625073.969833:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206070272 00000100:00100000:3.0:1788625073.969840:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206070272 00000100:00100000:0.0:1788625073.969902:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a75c8a5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206070784:0@lo:41: 00000100:00100000:0.0:1788625073.969934:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625073.969943:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788625073.969952:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059cdedf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7908:x1875509206070272:12345-0@lo:1000: 00000100:00100000:3.0:1788625073.970039:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059cdedf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7908:x1875509206070272:12345-0@lo:1000: Request processed in 89us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625073.970047:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788625073.971233:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206070784 00000100:00100000:1.0:1788625073.971243:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206070784 00000100:00100000:3.0:1788625073.971270:0:7908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000007a6d17 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7908:1875509206070272:0@lo:1000: 00000100:00100000:1.0:1788625073.971293:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788625073.971302:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002b44ced pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1875509206070784:12345-0@lo:41: 00000040:01000000:3.0:1788625073.971313:0:7908:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000004:00000024:1.0:1788625073.971330:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788625073.971352:0:7908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e35119a3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7908:1875509206070912:0@lo:1000: 00000100:00100000:3.0:1788625073.971397:0:7908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625073.971421:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002b44ced pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1875509206070784:12345-0@lo:41: Request processed in 121us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625073.971428:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625073.971465:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a75c8a5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206070784:0@lo:41: 00000100:00100000:3.0:1788625073.971684:0:7908:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f307ce29 going to sleep for 11 seconds 00000100:00100000:1.0:1788625073.971719:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206070912 00000100:00100000:1.0:1788625073.971724:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206070912 00000100:00100000:1.0:1788625073.971746:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788625073.971751:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076dae39c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7908:x1875509206070912:12345-0@lo:1000: 00000100:00100000:1.0:1788625073.971866:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076dae39c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7908:x1875509206070912:12345-0@lo:1000: Request processed in 115us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625073.971872:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788625073.971885:0:7908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e35119a3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7908:1875509206070912:0@lo:1000: 00000100:00100000:3.0:1788625073.971930:0:7908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e35119a3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7908:1875509206071040:0@lo:700: 00000100:00100000:3.0:1788625073.972051:0:7908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625073.972181:0:7908:0:(client.c:2716:ptlrpc_set_wait()) set 00000000faf369ef going to sleep for 11 seconds 00000100:00100000:0.0:1788625073.972312:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206071040 00000100:00100000:0.0:1788625073.972318:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206071040 00000100:00100000:2.0:1788625073.972397:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625073.972417:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e47ea04 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7908:x1875509206071040:12345-0@lo:700: 00000100:00100000:2.0:1788625073.972472:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e47ea04 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7908:x1875509206071040:12345-0@lo:700: Request processed in 69us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625073.972479:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625073.972608:0:7908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e35119a3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7908:1875509206071040:0@lo:700: 00000100:00100000:3.0:1788625073.972712:0:7908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e35119a3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7908:1875509206071168:0@lo:1000: 00000100:00100000:3.0:1788625073.972740:0:7908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625073.972758:0:7908:0:(client.c:2716:ptlrpc_set_wait()) set 000000004cc10f89 going to sleep for 11 seconds 00000100:00100000:2.0:1788625073.972881:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206071168 00000100:00100000:2.0:1788625073.972886:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206071168 00000100:00100000:2.0:1788625073.973853:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788625073.973864:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036e24624 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7908:x1875509206071168:12345-0@lo:1000: 00000100:00100000:2.0:1788625073.973950:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036e24624 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7908:x1875509206071168:12345-0@lo:1000: Request processed in 89us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625073.973957:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788625073.974190:0:7908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e35119a3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7908:1875509206071168:0@lo:1000: 00000004:00080000:0.0:1788625073.974248:0:7908:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000faf369ef with version 0 00000020:00100000:0.0:1788625073.974269:0:7908:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788625073.974275:0:7908:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a75c8a5b x1875509206071424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625073.974292:0:7908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a75c8a5b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7908:1875509206071424:0@lo:1000: 00000100:00100000:0.0:1788625073.974325:0:7908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625073.974351:0:7908:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d90166a3 going to sleep for 11 seconds 00000100:00100000:3.0:1788625073.974373:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206071424 00000100:00100000:3.0:1788625073.974380:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206071424 00000100:00100000:3.0:1788625073.974423:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788625073.974501:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6dab9c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7908:x1875509206071424:12345-0@lo:1000: 00000001:00080000:3.0:1788625073.979858:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1788625073.979873:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788625073.980046:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6dab9c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7908:x1875509206071424:12345-0@lo:1000: Request processed in 5545us (5718us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788625073.980068:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788625073.980215:0:7908:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788625073.980221:0:7908:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788625073.980236:0:7908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a75c8a5b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7908:1875509206071424:0@lo:1000: 00000100:00100000:0.0:1788625073.980322:0:7908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a75c8a5b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7908:1875509206071552:0@lo:1000: 00000100:00100000:0.0:1788625073.980367:0:7908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625073.980631:0:7908:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cb006226 going to sleep for 11 seconds 00000100:00100000:2.0:1788625073.980831:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206071552 00000100:00100000:2.0:1788625073.980838:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206071552 00000100:00100000:2.0:1788625073.980935:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788625073.980953:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024974a54 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7908:x1875509206071552:12345-0@lo:1000: 00000100:00100000:2.0:1788625073.981051:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024974a54 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7908:x1875509206071552:12345-0@lo:1000: Request processed in 110us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625073.981058:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788625073.981118:0:7908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a75c8a5b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7908:1875509206071552:0@lo:1000: 00000040:00080000:1.0:1788625073.981138:0:7908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788625073.981171:0:7908:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000de582f62 with version 1 00000004:00080000:0.0:1788625073.981366:0:7905:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000007bb0acc7 version 1 rpc_version 1 00000020:00100000:0.0:1788625073.981387:0:7905:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788625073.981395:0:7905:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005b9f8dc6 x1875509206071808/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625073.981413:0:7905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b9f8dc6 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7905:1875509206071808:0@lo:1000: 00000100:00100000:0.0:1788625073.981449:0:7905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625073.981466:0:7905:0:(client.c:2716:ptlrpc_set_wait()) set 00000000064ce037 going to sleep for 11 seconds 00000100:00100000:0.0:1788625073.981480:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206071808 00000100:00100000:0.0:1788625073.981483:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206071808 00000100:00100000:0.0:1788625073.981511:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788625073.981542:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a75c8a5b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7905:x1875509206071808:12345-0@lo:1000: 00000040:00080000:1.0:1788625073.986260:0:7908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788625073.986339:0:7908:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788625073.986343:0:7908:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:2.0:1788625073.991288:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1788625073.992535:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a75c8a5b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7905:x1875509206071808:12345-0@lo:1000: Request processed in 11015us (11082us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788625073.992556:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1788625073.992667:0:7905:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788625073.992678:0:7905:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788625073.992695:0:7905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b9f8dc6 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7905:1875509206071808:0@lo:1000: 00000020:00000080:0.0:1788625074.000959:0:7917:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5a9e2740 20000000:00000080:0.0:1788625074.000976:0:7917:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99887ca6d000 uarg=0000000000000000 20000000:01000000:0.0:1788625074.001026:0:7917:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788625074.001033:0:7917:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788625074.001038:0:7917:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788625074.001374:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788625074.001385:0:7917:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788625074.005365:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625074.007265:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788625074.007311:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788625074.007326:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788625074.007340:0:7917:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788625074.007368:0:7917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000084f86dcc/0x2d2e3b3f34a7a00a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625074.007385:0:7917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000290d483a/0x2d2e3b3f34a79e89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e82 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625074.007391:0:7917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006e4e099c/0x2d2e3b3f34a79f77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79f70 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625074.007396:0:7917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000084f86dcc/0x2d2e3b3f34a7a00a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625074.007430:0:7917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006e4e099c/0x2d2e3b3f34a79f77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a79f70 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625074.007441:0:7917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006e4e099c/0x2d2e3b3f34a79f77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f70 expref: 17 pid: 6506 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625074.007452:0:7917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d776827 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1875509206071936:0@lo:104: 00000100:00100000:2.0:1788625074.007510:0:7917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625074.007588:0:7917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000290d483a/0x2d2e3b3f34a79e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a79e82 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625074.007595:0:7917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000290d483a/0x2d2e3b3f34a79e89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e82 expref: 17 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625074.007603:0:7917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000070246cb2 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1875509206072064:0@lo:104: 00000100:00100000:2.0:1788625074.007628:0:7917:0:(client.c:2716:ptlrpc_set_wait()) set 0000000097b2073c going to sleep for 11 seconds 00000100:00100000:3.0:1788625074.007885:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788625074.007903:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625074.007957:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206071936 00000100:00100000:3.0:1788625074.007964:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206071936 00000100:00100000:1.0:1788625074.008471:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206072064 00000100:00100000:1.0:1788625074.008476:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206072064 00000100:00100000:1.0:1788625074.008501:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625074.008507:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043fb3b30 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:7917:x1875509206071936:12345-0@lo:104: 00010000:00010000:1.0:1788625074.008543:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79f70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79f77 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.008606:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788625074.008611:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043fb3b30 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:7917:x1875509206071936:12345-0@lo:104: Request processed in 105us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625074.008618:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625074.008656:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625074.008662:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fcad036b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:7917:x1875509206072064:12345-0@lo:104: 00010000:00010000:1.0:1788625074.008668:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: 00000000f1facfcb/0x2d2e3b3f34a79e82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79e89 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.008702:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788625074.008706:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fcad036b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:7917:x1875509206072064:12345-0@lo:104: Request processed in 46us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625074.008711:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788625074.008727:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625074.008732:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79f70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79f77 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.008738:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000080a91bfa already unused, calling callback (0000000091cf9fbc) 10000000:00010000:1.0:1788625074.008740:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79f70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a79f77 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.008755:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79f70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a79f77 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625074.008761:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79f70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a79f77 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625074.008766:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788625074.008791:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79f70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79f77 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.008796:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625074.008811:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79f70 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79f77 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.008816:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: 0000000080a91bfa/0x2d2e3b3f34a79f70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79f77 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.008830:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625074.008832:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: 00000000f1facfcb/0x2d2e3b3f34a79e82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79e89 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.008836:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f1facfcb already unused, calling callback (0000000091cf9fbc) 10000000:00010000:1.0:1788625074.008838:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: 00000000f1facfcb/0x2d2e3b3f34a79e82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a79e89 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.008842:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: 00000000f1facfcb/0x2d2e3b3f34a79e82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a79e89 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625074.008847:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: 00000000f1facfcb/0x2d2e3b3f34a79e82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a79e89 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625074.008856:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788625074.008865:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: 00000000f1facfcb/0x2d2e3b3f34a79e82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79e89 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.008870:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625074.008879:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: 00000000f1facfcb/0x2d2e3b3f34a79e82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79e89 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.008884:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: 00000000f1facfcb/0x2d2e3b3f34a79e82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79e89 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.008895:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625074.008896:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625074.008897:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625074.008915:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e02820b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206072192:0@lo:103: 00000100:00100000:1.0:1788625074.008941:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625074.008974:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625074.008981:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000889eb9a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206072320:0@lo:103: 00000100:00100000:1.0:1788625074.009012:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625074.009039:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206072192 00000100:00100000:1.0:1788625074.009043:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206072192 00010000:00010000:1.0:1788625074.009059:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006e4e099c/0x2d2e3b3f34a79f77 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f70 expref: 18 pid: 6506 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625074.009139:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206072320 00000100:00100000:1.0:1788625074.009142:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206072320 00010000:00010000:1.0:1788625074.009153:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000290d483a/0x2d2e3b3f34a79e89 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e82 expref: 19 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625074.009173:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625074.009178:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5f997c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:3638:x1875509206072192:12345-0@lo:103: 00010000:00010000:1.0:1788625074.009186:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625074.009190:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006e4e099c/0x2d2e3b3f34a79f77 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f70 expref: 19 pid: 6506 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.009198:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006e4e099c/0x2d2e3b3f34a79f77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f70 expref: 19 pid: 6506 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.009213:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625074.009308:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5f997c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:3638:x1875509206072192:12345-0@lo:103: Request processed in 130us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625074.009315:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625074.009327:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625074.009333:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005affc7c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:3636:x1875509206072320:12345-0@lo:103: 00010000:00010000:1.0:1788625074.009340:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625074.009343:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000290d483a/0x2d2e3b3f34a79e89 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e82 expref: 18 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.009351:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000290d483a/0x2d2e3b3f34a79e89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e82 expref: 18 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.009362:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000084f86dcc/0x2d2e3b3f34a7a00a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.009366:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000084f86dcc/0x2d2e3b3f34a7a00a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.009383:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000084f86dcc/0x2d2e3b3f34a7a00a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.009387:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000084f86dcc/0x2d2e3b3f34a7a00a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.009391:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000084f86dcc/0x2d2e3b3f34a7a00a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.009394:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000084f86dcc/0x2d2e3b3f34a7a00a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.009397:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000084f86dcc already unused, calling callback (0000000055fa61c0) 00010000:00010000:1.0:1788625074.009399:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000084f86dcc/0x2d2e3b3f34a7a00a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.009402:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000084f86dcc/0x2d2e3b3f34a7a00a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.009406:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000084f86dcc/0x2d2e3b3f34a7a00a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.009412:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625074.009431:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005affc7c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:3636:x1875509206072320:12345-0@lo:103: Request processed in 100us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625074.009435:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625074.009461:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000889eb9a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206072320:0@lo:103: 00000100:00100000:1.0:1788625074.009475:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e02820b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206072192:0@lo:103: 00010000:00010000:0.0:1788625074.010087:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625074.010183:0:7917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006e4e099c/0x2d2e3b3f34a79f77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f70 expref: 17 pid: 6506 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625074.010195:0:7917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d776827 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1875509206071936:0@lo:104: 00010000:00010000:2.0:1788625074.010202:0:7917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000290d483a/0x2d2e3b3f34a79e89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a79e82 expref: 16 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625074.010208:0:7917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000070246cb2 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1875509206072064:0@lo:104: 00010000:00010000:2.0:1788625074.010222:0:7917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000084f86dcc/0x2d2e3b3f34a7a00a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625074.010230:0:7917:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000084f86dcc/0x2d2e3b3f34a7a00a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625074.010235:0:7917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000084f86dcc/0x2d2e3b3f34a7a00a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625074.010240:0:7917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000084f86dcc/0x2d2e3b3f34a7a00a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625074.251947:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625075.276691:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625075.469764:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018fb4bcb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206072448:0@lo:41: 00000100:00100000:3.0:1788625075.469854:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625075.470304:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206072448 00000100:00100000:2.0:1788625075.470312:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206072448 00000100:00100000:2.0:1788625075.470368:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788625075.470376:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fc23574 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206072448:12345-0@lo:41: 00000004:00000024:2.0:1788625075.470408:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788625075.470469:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fc23574 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206072448:12345-0@lo:41: Request processed in 94us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625075.470475:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788625075.470903:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018fb4bcb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206072448:0@lo:41: 00010000:00010000:0.0:1788625076.300776:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625077.324671:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625078.357843:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625079.057481:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625079.057506:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000070246cb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206072576:0@lo:41: 00000100:00100000:0.0:1788625079.057602:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625079.057774:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206072576 00000100:00100000:2.0:1788625079.057783:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206072576 00000100:00100000:0.0:1788625079.058241:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cbe931f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206073088:0@lo:400: 00000100:00100000:0.0:1788625079.058278:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625079.058309:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625079.058314:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003cdae550 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206072704:0@lo:400: 00000100:00100000:0.0:1788625079.058344:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625079.058372:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2e874b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206072960:0@lo:400: 00000100:00100000:0.0:1788625079.058395:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625079.059621:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206072704 00000100:00100000:1.0:1788625079.059630:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206072704 00000100:00100000:1.0:1788625079.059673:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788625079.059681:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064c3b085 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:3637:x1875509206072704:12345-0@lo:400: 00000100:00100000:1.0:1788625079.059743:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064c3b085 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:3637:x1875509206072704:12345-0@lo:400: Request processed in 63us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625079.059750:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788625079.059780:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206073088 00000100:00100000:1.0:1788625079.059783:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206073088 00000100:00100000:1.0:1788625079.059808:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788625079.059813:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99f842 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206073088:12345-0@lo:400: 00000100:00100000:1.0:1788625079.059842:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99f842 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206073088:12345-0@lo:400: Request processed in 30us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625079.059848:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625079.062359:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625079.062378:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e6b8165 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206072832:0@lo:400: 00000100:00100000:0.0:1788625079.062436:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625079.062485:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206072832 00000100:00100000:0.0:1788625079.062507:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206072832 00000100:00100000:0.0:1788625079.062566:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788625079.062573:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002613a292 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206072832:12345-0@lo:400: 00000100:00100000:0.0:1788625079.062622:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002613a292 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206072832:12345-0@lo:400: Request processed in 49us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625079.062629:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788625079.062700:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003cdae550 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206072704:0@lo:400: 00010000:00080000:0.0:1788625079.062716:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002cbe931f x1875509206073088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625079.062728:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cbe931f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206073088:0@lo:400: 00010000:00080000:0.0:1788625079.062761:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009e6b8165 x1875509206072832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625079.062769:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e6b8165 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206072832:0@lo:400: 00000100:00100000:2.0:1788625079.063329:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206072960 00000100:00100000:2.0:1788625079.063338:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206072960 00000100:00100000:2.0:1788625079.063371:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625079.063380:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b69b8cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206072576:12345-0@lo:41: 00000004:00000024:2.0:1788625079.063415:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788625079.063490:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b69b8cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206072576:12345-0@lo:41: Request processed in 112us (5889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625079.063497:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625079.063511:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788625079.063533:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a8f1c70 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206072960:12345-0@lo:400: 00000100:00100000:2.0:1788625079.063565:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a8f1c70 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206072960:12345-0@lo:400: Request processed in 49us (5169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625079.063571:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625079.063723:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000070246cb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206072576:0@lo:41: 00000100:00100000:0.0:1788625079.063808:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2e874b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206072960:0@lo:400: 00010000:00010000:1.0:1788625079.371613:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788625079.564656:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788625079.564665:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99886c323000 from 1 10000000:01000000:1.0:1788625079.564669:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625079.564716:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: 0000000077e014e6/0x2d2e3b3f34a7a011 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625079.564729:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: 0000000077e014e6/0x2d2e3b3f34a7a011 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625079.564740:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: 0000000077e014e6/0x2d2e3b3f34a7a011 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625079.564761:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e02820b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206073216:0@lo:101: 00000100:00100000:1.0:1788625079.564836:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625079.564908:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c26fdb04 going to sleep for 11 seconds 00000100:00100000:2.0:1788625079.565640:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206073216 00000100:00100000:2.0:1788625079.565650:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206073216 00000100:00100000:2.0:1788625079.565724:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788625079.565733:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e733152e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206073216:12345-0@lo:101: 00010000:00010000:2.0:1788625079.565747:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625079.565763:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000513c24be/0x2d2e3b3f34a7a018 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a011 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625079.565788:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000513c24be/0x2d2e3b3f34a7a018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a011 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625079.565798:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000513c24be/0x2d2e3b3f34a7a018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a011 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625079.565821:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000513c24be, rc 0) 00000100:00100000:2.0:1788625079.565875:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e733152e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206073216:12345-0@lo:101: Request processed in 144us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625079.565882:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788625079.565929:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e02820b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206073216:0@lo:101: 00010000:00010000:1.0:1788625079.565945:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: 0000000077e014e6/0x2d2e3b3f34a7a011 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a018 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625079.566015:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: 0000000077e014e6/0x2d2e3b3f34a7a011 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a018 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625079.566081:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e02820b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206073344:0@lo:501: 00000100:00100000:1.0:1788625079.566109:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625079.566143:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c26fdb04 going to sleep for 11 seconds 00000100:00100000:2.0:1788625079.566167:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206073344 00000100:00100000:2.0:1788625079.566172:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206073344 00000100:00100000:2.0:1788625079.566214:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788625079.566221:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bc3afb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206073344:12345-0@lo:501: 00000100:00100000:2.0:1788625079.566340:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bc3afb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206073344:12345-0@lo:501: Request processed in 120us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625079.566348:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788625079.566577:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e02820b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206073344:0@lo:501: 00000100:00100000:3.0:1788625079.566614:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb441bb0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206073472:0@lo:503: 00000100:00100000:3.0:1788625079.566653:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625079.566691:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 000000001a013a76 going to sleep for 11 seconds 00000100:00100000:2.0:1788625079.566705:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206073472 00000100:00100000:2.0:1788625079.566709:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206073472 00000100:00100000:2.0:1788625079.566737:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788625079.566743:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0f13c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206073472:12345-0@lo:503: 00000100:00100000:2.0:1788625079.566818:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0f13c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206073472:12345-0@lo:503: Request processed in 75us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625079.566824:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788625079.566849:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb441bb0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206073472:0@lo:503: 00000100:00100000:0.0:1788625079.578933:0:8238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2e874b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8238:1875509206073600:0@lo:502: 00000100:00100000:0.0:1788625079.579014:0:8238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625079.579059:0:8238:0:(client.c:2716:ptlrpc_set_wait()) set 00000000315a6bae going to sleep for 11 seconds 00000100:00100000:2.0:1788625079.579166:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206073600 00000100:00100000:2.0:1788625079.579175:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206073600 00000100:00100000:2.0:1788625079.579342:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788625079.579352:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008add7b27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:8238:x1875509206073600:12345-0@lo:502: 00000100:00100000:2.0:1788625079.579479:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008add7b27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:8238:x1875509206073600:12345-0@lo:502: Request processed in 128us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625079.579487:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788625079.581559:0:8238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2e874b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8238:1875509206073600:0@lo:502: 00000020:01000000:1.0:1788625079.581615:0:8238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625079.581627:0:8238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625079.581629:0:8238:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788625079.581638:0:8238:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99886c323000 00000020:00000080:1.0:1788625079.581641:0:8238:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788625079.581704:0:8238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8238:1875509206073728:0@lo:502: 00000100:00100000:1.0:1788625079.581768:0:8238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625079.585134:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206073728 00000100:00100000:0.0:1788625079.585148:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206073728 00000100:00100000:0.0:1788625079.585569:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788625079.585582:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:8238:x1875509206073728:12345-0@lo:502: 00000100:00100000:0.0:1788625079.585793:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:8238:x1875509206073728:12345-0@lo:502: Request processed in 214us (4024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625079.585801:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788625079.589364:0:8238:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c8989c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625079.589410:0:8238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8238:1875509206073728:0@lo:502: 00000020:01000000:1.0:1788625079.589459:0:8238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625079.589470:0:8238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625079.589473:0:8238:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788625079.589478:0:8238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788625079.590062:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788625079.590087:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788625079.590100:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9400/0x2d2e3b3f34a7a011 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a018 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625079.590113:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be9400/0x2d2e3b3f34a7a011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a018 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625079.590125:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788625079.590127:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998852348000 from 1 10000000:01000000:3.0:1788625079.590130:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625079.590166:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882171200/0x2d2e3b3f34a7a01f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625079.590174:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998882171200/0x2d2e3b3f34a7a01f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625079.590198:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998882171200/0x2d2e3b3f34a7a01f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625079.590289:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206073856:0@lo:101: 00000100:00100000:3.0:1788625079.590354:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625079.590435:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885eefaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625079.591149:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206073856 00000100:00100000:0.0:1788625079.591164:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206073856 00000100:00100000:1.0:1788625079.591370:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788625079.591379:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206073856:12345-0@lo:101: 00010000:00010000:1.0:1788625079.591398:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625079.591410:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998859be9600/0x2d2e3b3f34a7a026 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a01f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625079.591434:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998859be9600/0x2d2e3b3f34a7a026 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a01f expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625079.591445:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998859be9600/0x2d2e3b3f34a7a026 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a01f expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625079.591454:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be9600, rc 0) 00000100:00100000:1.0:1788625079.591536:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206073856:12345-0@lo:101: Request processed in 138us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625079.591542:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788625079.591617:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206073856:0@lo:101: 00010000:00010000:3.0:1788625079.591640:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998882171200/0x2d2e3b3f34a7a01f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a026 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625079.591650:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998882171200/0x2d2e3b3f34a7a01f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a026 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625079.591713:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206073984:0@lo:501: 00000100:00100000:3.0:1788625079.591736:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625079.592022:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885eefaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625079.592088:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206073984 00000100:00100000:2.0:1788625079.592099:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206073984 00000100:00100000:2.0:1788625079.592122:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788625079.592128:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206073984:12345-0@lo:501: 00000100:00100000:2.0:1788625079.592240:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206073984:12345-0@lo:501: Request processed in 111us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625079.592247:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788625079.592361:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206073984:0@lo:501: 00000100:00100000:3.0:1788625079.592398:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206074112:0@lo:503: 00000100:00100000:3.0:1788625079.592427:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625079.592446:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885eefaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625079.592503:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206074112 00000100:00100000:2.0:1788625079.592506:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206074112 00000100:00100000:2.0:1788625079.592533:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788625079.592539:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206074112:12345-0@lo:503: 00000100:00100000:2.0:1788625079.592623:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206074112:12345-0@lo:503: Request processed in 84us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625079.592639:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788625079.592840:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206074112:0@lo:503: 00000100:00100000:3.0:1788625079.593253:0:8239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8239:1875509206074240:0@lo:502: 00000100:00100000:3.0:1788625079.593289:0:8239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625079.593322:0:8239:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885eefa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625079.593432:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206074240 00000100:00100000:2.0:1788625079.593437:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206074240 00000100:00100000:2.0:1788625079.593458:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788625079.593465:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:8239:x1875509206074240:12345-0@lo:502: 00000100:00100000:2.0:1788625079.593578:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:8239:x1875509206074240:12345-0@lo:502: Request processed in 113us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625079.593585:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788625079.593806:0:8239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8239:1875509206074240:0@lo:502: 00000020:01000000:3.0:1788625079.593835:0:8239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625079.593845:0:8239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625079.593847:0:8239:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788625079.593859:0:8239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998852348000 00000020:00000080:3.0:1788625079.593861:0:8239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788625079.593883:0:8239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8239:1875509206074368:0@lo:502: 00000100:00100000:3.0:1788625079.593926:0:8239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625079.593954:0:8239:0:(client.c:2716:ptlrpc_set_wait()) set ffff998878108000 going to sleep for 11 seconds 00000100:00100000:2.0:1788625079.594000:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206074368 00000100:00100000:2.0:1788625079.594004:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206074368 00000100:00100000:2.0:1788625079.594021:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788625079.594026:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:8239:x1875509206074368:12345-0@lo:502: 00000100:00100000:2.0:1788625079.594093:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:8239:x1875509206074368:12345-0@lo:502: Request processed in 66us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625079.594099:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788625079.594414:0:8239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8239:1875509206074368:0@lo:502: 00000020:01000000:3.0:1788625079.594430:0:8239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625079.594433:0:8239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625079.594435:0:8239:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788625079.594440:0:8239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788625079.594782:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788625079.594803:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625079.594814:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882171200/0x2d2e3b3f34a7a01f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a026 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625079.594826:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998882171200/0x2d2e3b3f34a7a01f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a026 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625080.396925:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625080.588759:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625080.588782:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206074496:0@lo:41: 00000100:00100000:3.0:1788625080.588883:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625080.590234:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206074496 00000100:00100000:2.0:1788625080.590246:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206074496 00000100:00100000:2.0:1788625080.590314:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788625080.590324:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206074496:12345-0@lo:41: 00000004:00000024:2.0:1788625080.590362:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788625080.590436:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206074496:12345-0@lo:41: Request processed in 114us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625080.590444:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788625080.590493:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206074496:0@lo:41: 00010000:00010000:1.0:1788625081.444197:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625082.454674:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788625082.939422:0:8417:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788625082.939427:0:8417:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788625082.939428:0:8417:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788625082.939670:0:8417:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff998878127800 00000020:01000004:3.0:1788625082.939687:0:8417:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788625082.939700:0:8417:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788625082.939714:0:8417:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99885e62cd40) 00000020:00000080:3.0:1788625082.939731:0:8417:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788625082.980470:0:8417:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788625082.980768:0:8417:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1788625082.993290:0:8417:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788625082.993828:0:8417:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788625082.993842:0:8417:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788625082.993854:0:8417:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2d2e3b3f34a7a034 00000020:01000004:0.0:1788625082.993861:0:8417:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788625082.993953:0:8417:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.114@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788625082.993957:0:8417:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788625082.993964:0:8417:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788625082.993969:0:8417:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788625082.993980:0:8417:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99887394cd40) 00000020:00000080:0.0:1788625082.993995:0:8417:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1788625082.996014:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625082.996216:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788625082.996223:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788625082.996982:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788625082.996989:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788625082.997254:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788625082.997262:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788625083.001902:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625083.002082:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788625083.002089:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788625083.010692:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788625083.010707:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788625083.033773:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788625083.034056:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788625083.034063:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788625083.036436:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788625083.036452:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788625083.042035:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788625083.042056:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788625083.045630:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788625083.045850:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788625083.045858:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788625083.046513:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788625083.046590:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788625083.099182:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788625083.099462:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788625083.099470:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788625083.101123:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788625083.101133:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788625083.101886:0:8417:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788625083.101915:0:8417:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788625083.101922:0:8417:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788625083.121155:0:8417:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788625083.121207:0:8417:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.114@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788625083.121211:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788625083.121214:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788625083.121215:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625083.121216:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625083.121218:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625083.121219:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625083.121220:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625083.121222:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788625083.121224:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788625083.121226:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625083.121227:0:8417:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788625083.121231:0:8417:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788625083.121234:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788625083.121235:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788625083.121237:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625083.121238:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625083.121239:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625083.121240:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625083.121241:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625083.121243:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788625083.121244:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788625083.121250:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625083.121251:0:8417:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788625083.121283:0:8417:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788625083.121305:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206074624:0@lo:253: 00000100:00100000:3.0:1788625083.121450:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625083.121631:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842c330c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625083.121674:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206074624 00000100:00100000:2.0:1788625083.121681:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206074624 00000100:00100000:2.0:1788625083.121731:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788625083.121739:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:8417:x1875509206074624:12345-0@lo:253: 20000000:01000000:2.0:1788625083.121778:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788625083.121782:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788625083.121787:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788625083.121790:0:6505:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788625083.122722:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625083.122886:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788625083.122902:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788625083.122920:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788625083.122926:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788625083.122938:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788625083.122955:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788625083.123040:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788625083.123056:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.114@tcp 20000000:01000000:2.0:1788625083.123058:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.114@tcp (null) (null) (null) 00000040:00080000:2.0:1788625083.123074:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788625083.123081:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788625083.123111:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788625083.123120:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.114@tcp (null) (null) 00000040:00080000:2.0:1788625083.123133:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788625083.123140:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788625083.123152:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788625083.123166:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788625083.123235:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1788625083.123247:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.114@tcp 20000000:01000000:2.0:1788625083.123249:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.114@tcp (null) (null) (null) 00000040:00080000:2.0:1788625083.123264:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1788625083.123270:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788625083.123284:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1788625083.123290:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.114@tcp (null) (null) 00000040:00080000:2.0:1788625083.123303:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1788625083.123309:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788625083.123323:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1788625083.123339:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1788625083.124879:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1788625083.124903:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.114@tcp 20000000:01000000:2.0:1788625083.124919:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.114@tcp (null) (null) (null) 00000040:00080000:2.0:1788625083.124937:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1788625083.124946:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788625083.124960:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1788625083.124965:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.114@tcp (null) (null) 00000040:00080000:2.0:1788625083.124976:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1788625083.124981:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788625083.124992:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1788625083.125006:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788625083.125020:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788625083.125023:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788625083.125026:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788625083.125067:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788625083.125070:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788625083.128503:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788625083.128755:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788625083.128801:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788625083.128828:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788625083.128851:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788625083.128853:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788625083.131771:0:8437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1788625083.131831:0:8437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1788625083.131850:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788625083.132162:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788625083.132189:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788625083.132203:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1788625083.132214:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788625083.132216:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788625083.134197:0:8438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1788625083.134240:0:8438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1788625083.134254:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788625083.134559:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788625083.134595:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788625083.134612:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788625083.134622:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788625083.134624:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788625083.135302:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1788625083.135331:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1788625083.135345:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1788625083.135610:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1788625083.135633:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1788625083.135648:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:2.0:1788625083.135663:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788625083.135701:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a042 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.135727:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998882044000/0x2d2e3b3f34a79f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79f07 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.135736:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998840030600/0x2d2e3b3f34a79f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79f7e expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.135743:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998882045a00/0x2d2e3b3f34a79fbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79fb6 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.135750:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887c995600/0x2d2e3b3f34a79fd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79fd2 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.135757:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a003 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79ffc expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.135764:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a042 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.135804:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a79ffc expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.135830:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a003 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79ffc expref: 18 pid: 6505 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625083.135844:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1875509206074752:0@lo:104: 00000100:00100000:2.0:1788625083.135908:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625083.135972:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887c995600/0x2d2e3b3f34a79fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a79fd2 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.135990:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887c995600/0x2d2e3b3f34a79fd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fd2 expref: 18 pid: 6503 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625083.135999:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4ded80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1875509206074880:0@lo:104: 00000100:00100000:2.0:1788625083.136021:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625083.136056:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998882045a00/0x2d2e3b3f34a79fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a79fb6 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.136064:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998882045a00/0x2d2e3b3f34a79fbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fb6 expref: 18 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625083.136071:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1875509206075008:0@lo:104: 00000100:00100000:2.0:1788625083.136108:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625083.136126:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998840030600/0x2d2e3b3f34a79f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a79f7e expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.136134:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998840030600/0x2d2e3b3f34a79f85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f7e expref: 18 pid: 6503 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625083.136141:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206074752 00000100:00100000:2.0:1788625083.136141:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1875509206075136:0@lo:104: 00000100:00100000:3.0:1788625083.136148:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206074752 00000100:00100000:2.0:1788625083.136160:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625083.136178:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206074880 00000100:00100000:3.0:1788625083.136181:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206074880 00010000:00010000:2.0:1788625083.136184:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998882044000/0x2d2e3b3f34a79f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a79f07 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625083.136190:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206075008 00000100:00100000:3.0:1788625083.136192:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206075008 00010000:00010000:2.0:1788625083.136192:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998882044000/0x2d2e3b3f34a79f0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f07 expref: 18 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625083.136199:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206075136 00000100:00100000:3.0:1788625083.136201:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206075136 00000100:00100000:2.0:1788625083.136201:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1875509206075264:0@lo:104: 00000100:00100000:3.0:1788625083.136212:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625083.136220:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:6505:x1875509206074752:12345-0@lo:104: 00000100:00100000:2.0:1788625083.136224:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625083.136232:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887c995000/0x2d2e3b3f34a79ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a003 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625083.136233:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842a876c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625083.136309:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1875509206074752:0@lo:104: 00000100:00100000:1.0:1788625083.136379:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788625083.136386:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1788625083.136708:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625083.136716:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:6505:x1875509206074752:12345-0@lo:104: Request processed in 496us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625083.136724:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625083.136739:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206075264 00000100:00100000:3.0:1788625083.136742:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206075264 00000100:00100000:3.0:1788625083.136757:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788625083.136763:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:6505:x1875509206074880:12345-0@lo:104: 00010000:00010000:3.0:1788625083.136778:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a79fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625083.138776:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4ded80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1875509206074880:0@lo:104: 00010000:00010000:0.0:1788625083.139242:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788625083.139252:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887c995000/0x2d2e3b3f34a79ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a003 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.139262:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995000 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625083.139266:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887c995000/0x2d2e3b3f34a79ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a003 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.139277:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887c995000/0x2d2e3b3f34a79ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a003 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625083.139309:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887c995000/0x2d2e3b3f34a79ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a003 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625083.139315:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788625083.140211:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625083.140225:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:6505:x1875509206075008:12345-0@lo:104: 00010000:00010000:0.0:1788625083.140238:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887c995000/0x2d2e3b3f34a79ffc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a003 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.140244:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625083.140246:0:8440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998882045e00/0x2d2e3b3f34a79fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.140271:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887c995000/0x2d2e3b3f34a79ffc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a003 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.140279:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887c995000/0x2d2e3b3f34a79ffc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a003 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.140291:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625083.140294:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a79fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.140301:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994200 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625083.140304:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a79fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a79fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.140311:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a79fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a79fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625083.140318:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a79fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a79fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625083.140323:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788625083.140351:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206075392:0@lo:103: 00000100:00100000:2.0:1788625083.140415:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625083.140651:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206075392 00000100:00100000:2.0:1788625083.140658:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206075392 00010000:00010000:2.0:1788625083.140683:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a003 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79ffc expref: 19 pid: 6505 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625083.140773:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788625083.140781:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:3635:x1875509206075392:12345-0@lo:103: 00010000:00010000:2.0:1788625083.140792:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625083.140797:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a003 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79ffc expref: 19 pid: 6505 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.140809:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79ffc expref: 19 pid: 6505 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.140835:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a003 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a79ffc expref: 19 pid: 6505 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.140848:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625083.140880:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:3635:x1875509206075392:12345-0@lo:103: Request processed in 100us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625083.140887:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788625083.140917:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a79fd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.140925:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788625083.140931:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206075392:0@lo:103: 00010000:00010000:0.0:1788625083.140932:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a79fd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.140938:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a79fd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.140948:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625083.140950:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625083.140952:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625083.140963:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206075520:0@lo:103: 00000100:00100000:0.0:1788625083.140989:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625083.141018:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206075520 00000100:00100000:0.0:1788625083.141021:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206075520 00010000:00010000:0.0:1788625083.141037:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887c995600/0x2d2e3b3f34a79fd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fd2 expref: 18 pid: 6503 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141244:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788625083.141250:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:6505:x1875509206075008:12345-0@lo:104: Request processed in 1029us (5142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625083.141257:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625083.141286:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788625083.141294:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:6505:x1875509206075136:12345-0@lo:104: 00010000:00010000:1.0:1788625083.141303:0:8440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998882045800/0x2d2e3b3f34a79f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79f85 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141333:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788625083.141338:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:6505:x1875509206075136:12345-0@lo:104: Request processed in 46us (5177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625083.141343:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788625083.141355:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788625083.141361:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:6505:x1875509206075264:12345-0@lo:104: 00010000:00010000:1.0:1788625083.141369:0:8440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998840031200/0x2d2e3b3f34a79f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79f0e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141395:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788625083.141400:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:6505:x1875509206075264:12345-0@lo:104: Request processed in 40us (5175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625083.141405:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788625083.141573:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788625083.141579:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998882045e00/0x2d2e3b3f34a79fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141593:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882045e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625083.141596:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998882045e00/0x2d2e3b3f34a79fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a79fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141604:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998882045e00/0x2d2e3b3f34a79fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a79fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625083.141610:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998882045e00/0x2d2e3b3f34a79fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a79fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625083.141615:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625083.141640:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998882045e00/0x2d2e3b3f34a79fb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141646:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625083.141659:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998882045e00/0x2d2e3b3f34a79fb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141665:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998882045e00/0x2d2e3b3f34a79fb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141675:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625083.141678:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998882045800/0x2d2e3b3f34a79f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79f85 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141684:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882045800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625083.141687:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998882045800/0x2d2e3b3f34a79f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a79f85 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141715:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998882045800/0x2d2e3b3f34a79f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a79f85 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625083.141721:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998882045800/0x2d2e3b3f34a79f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a79f85 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625083.141726:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625083.141739:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998882045800/0x2d2e3b3f34a79f7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79f85 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141744:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625083.141749:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998882045800/0x2d2e3b3f34a79f7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79f85 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141755:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998882045800/0x2d2e3b3f34a79f7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79f85 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141763:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625083.141766:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998840031200/0x2d2e3b3f34a79f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79f0e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141781:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840031200 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625083.141784:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998840031200/0x2d2e3b3f34a79f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a79f0e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141791:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998840031200/0x2d2e3b3f34a79f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a79f0e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625083.141797:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998840031200/0x2d2e3b3f34a79f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a79f0e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625083.141808:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625083.141833:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998840031200/0x2d2e3b3f34a79f07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79f0e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141839:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625083.141851:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998840031200/0x2d2e3b3f34a79f07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79f0e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141857:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998840031200/0x2d2e3b3f34a79f07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79f0e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.141870:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625083.141872:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625083.141874:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625083.141965:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788625083.141974:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:3636:x1875509206075520:12345-0@lo:103: 00010000:00010000:0.0:1788625083.141985:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625083.141989:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887c995600/0x2d2e3b3f34a79fd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fd2 expref: 18 pid: 6503 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.141998:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887c995600/0x2d2e3b3f34a79fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fd2 expref: 18 pid: 6503 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.142009:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c995600/0x2d2e3b3f34a79fd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fd2 expref: 18 pid: 6503 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.142025:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625083.142476:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788625083.142491:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:6505:x1875509206074880:12345-0@lo:104: Request processed in 5726us (6468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625083.142498:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788625083.142712:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:3636:x1875509206075520:12345-0@lo:103: Request processed in 740us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625083.142719:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788625083.143000:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206075648:0@lo:103: 00000100:00100000:3.0:1788625083.143043:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788625083.143127:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625083.143627:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206075520:0@lo:103: 00000100:00100000:1.0:1788625083.143648:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625083.143655:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206075904:0@lo:103: 00000100:00100000:1.0:1788625083.145646:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206075776:0@lo:103: 00000100:00100000:2.0:1788625083.148765:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206075648 00000100:00100000:2.0:1788625083.148791:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206075648 00010000:00010000:2.0:1788625083.148851:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998882045a00/0x2d2e3b3f34a79fbd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fb6 expref: 17 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625083.148882:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625083.148892:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844936300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:3637:x1875509206075648:12345-0@lo:103: 00010000:00010000:2.0:1788625083.148909:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625083.148916:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998882045a00/0x2d2e3b3f34a79fbd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fb6 expref: 17 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.148929:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998882045a00/0x2d2e3b3f34a79fbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fb6 expref: 17 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.149022:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625083.149094:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844936300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:3637:x1875509206075648:12345-0@lo:103: Request processed in 203us (6050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625083.149102:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788625083.149589:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625083.150647:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882045a00/0x2d2e3b3f34a79fbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fb6 expref: 16 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625083.150669:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1875509206075008:0@lo:104: 00000100:00100000:2.0:1788625083.150680:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1875509206075136:0@lo:104: 00000100:00100000:2.0:1788625083.150688:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1875509206075264:0@lo:104: 00000100:00100000:0.0:1788625083.151161:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625083.151257:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206075648:0@lo:103: 00000100:00100000:3.0:1788625083.151286:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625083.151439:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206075776 00000100:00100000:0.0:1788625083.151446:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206075776 00000100:00100000:3.0:1788625083.151578:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206075904 00000100:00100000:3.0:1788625083.151582:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206075904 00010000:00010000:3.0:1788625083.151687:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998882044000/0x2d2e3b3f34a79f0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f07 expref: 17 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625083.151715:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788625083.151724:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:3636:x1875509206075904:12345-0@lo:103: 00010000:00010000:3.0:1788625083.151737:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625083.151743:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998882044000/0x2d2e3b3f34a79f0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f07 expref: 17 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625083.151753:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998882044000/0x2d2e3b3f34a79f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f07 expref: 17 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625083.151770:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882044000/0x2d2e3b3f34a79f0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f07 expref: 17 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625083.151784:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625083.151954:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:3636:x1875509206075904:12345-0@lo:103: Request processed in 231us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625083.151962:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788625083.152158:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206075904:0@lo:103: 00010000:00010000:0.0:1788625083.152241:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998840030600/0x2d2e3b3f34a79f85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f7e expref: 15 pid: 6503 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625083.152300:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625083.152309:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:3638:x1875509206075776:12345-0@lo:103: 00010000:00010000:0.0:1788625083.152317:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625083.152321:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998840030600/0x2d2e3b3f34a79f85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f7e expref: 15 pid: 6503 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.152331:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998840030600/0x2d2e3b3f34a79f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f7e expref: 15 pid: 6503 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.152341:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998840030600/0x2d2e3b3f34a79f85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a79f7e expref: 15 pid: 6503 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.152364:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a042 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.152372:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a042 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.152388:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a042 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.152401:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a042 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.152408:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a042 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.152415:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a042 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.152421:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625083.152424:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a042 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.152431:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a042 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.152440:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a042 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.152449:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625083.152667:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:3638:x1875509206075776:12345-0@lo:103: Request processed in 359us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625083.152674:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625083.152798:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206075776:0@lo:103: 00010000:00010000:2.0:1788625083.156146:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a042 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.156168:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a042 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.156192:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a042 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.156199:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a042 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788625083.156218:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788625083.166751:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+13:8417:x1875509206074624:12345-0@lo:253: Request processed in 45004us (45292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625083.166765:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788625083.166861:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206074624:0@lo:253: 10000000:01000000:3.0:1788625083.166877:0:8417:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788625083.166880:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788625083.166882:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788625083.166883:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625083.166884:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788625083.166885:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625083.166886:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625083.166888:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625083.166889:0:8417:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788625083.166891:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625083.166892:0:8417:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788625083.166914:0:8417:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998878127800 from lustre-OST0000 10000000:01000000:3.0:1788625083.166944:0:8417:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788625083.166946:0:8417:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788625083.166954:0:8417:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99885ecd99c0 local copy 10000000:01000000:3.0:1788625083.166958:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788625083.166995:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7a049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625083.167006:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7a049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625083.167015:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7a049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625083.167032:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206076032:0@lo:101: 00000100:00100000:3.0:1788625083.167129:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625083.167171:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fdd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625083.167431:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206076032 00000100:00100000:0.0:1788625083.167439:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206076032 00000100:00100000:0.0:1788625083.167503:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788625083.167511:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+13:8417:x1875509206076032:12345-0@lo:101: 00010000:00010000:0.0:1788625083.167653:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625083.167670:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c995600/0x2d2e3b3f34a7a050 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a049 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.167695:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c995600/0x2d2e3b3f34a7a050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a049 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.167705:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c995600/0x2d2e3b3f34a7a050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a049 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.167916:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995600, rc 0) 00000100:00100000:0.0:1788625083.168013:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:8417:x1875509206076032:12345-0@lo:101: Request processed in 503us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625083.168021:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788625083.168145:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206076032:0@lo:101: 00010000:00010000:3.0:1788625083.168160:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7a049 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2d2e3b3f34a7a050 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625083.168175:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7a049 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2d2e3b3f34a7a050 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625083.169429:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206076160:0@lo:501: 00000100:00100000:3.0:1788625083.169484:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625083.169662:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fdd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625083.169717:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206076160 00000100:00100000:0.0:1788625083.169724:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206076160 00000100:00100000:0.0:1788625083.169772:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788625083.169781:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:8417:x1875509206076160:12345-0@lo:501: 00000100:00100000:0.0:1788625083.169905:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:8417:x1875509206076160:12345-0@lo:501: Request processed in 125us (420us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788625083.169912:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788625083.169973:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206076160:0@lo:501: 10000000:01000000:3.0:1788625083.169988:0:8417:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788625083.170004:0:8417:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788625083.170011:0:8417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7a049 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2d2e3b3f34a7a050 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625083.170020:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7a049 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2d2e3b3f34a7a050 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625083.170027:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7a049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2d2e3b3f34a7a050 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625083.170104:0:8417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788625083.170130:0:8417:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998878127800 10000000:01000000:3.0:1788625083.170135:0:8417:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788625083.170141:0:8417:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788625083.170143:0:8417:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788625083.170147:0:8417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788625083.170149:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788625083.170169:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882170800/0x2d2e3b3f34a7a057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.170180:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625083.170190:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7a049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x2d2e3b3f34a7a050 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625083.170193:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998882170800/0x2d2e3b3f34a7a057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.170208:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170c00 already unused, calling callback (ffffffffc13d7c20) 00010000:00010000:3.0:1788625083.170212:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998882170800/0x2d2e3b3f34a7a057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625083.170213:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7a049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x2d2e3b3f34a7a050 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.170224:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7a049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x2d2e3b3f34a7a050 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625083.170239:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7a049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x2d2e3b3f34a7a050 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625083.170245:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625083.170267:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7a049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x2d2e3b3f34a7a050 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.170274:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788625083.170291:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206076288:0@lo:101: 00000100:00100000:3.0:1788625083.170321:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625083.170347:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842c330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625083.170366:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206076416:0@lo:103: 00000100:00100000:0.0:1788625083.170404:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625083.170409:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206076288 00000100:00100000:2.0:1788625083.170416:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206076288 00000100:00100000:2.0:1788625083.170457:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788625083.170467:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:8417:x1875509206076288:12345-0@lo:101: 00010000:00010000:2.0:1788625083.170477:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625083.170491:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a05e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a057 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.170504:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7a049 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2d2e3b3f34a7a050 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.170537:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a05e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a057 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.170540:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7a049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2d2e3b3f34a7a050 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.170560:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a05e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a057 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.170565:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625083.170569:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625083.170571:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6a00, rc 0) 00010000:00010000:1.0:1788625083.170571:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625083.170613:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8417:x1875509206076288:12345-0@lo:101: Request processed in 149us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625083.170620:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788625083.170755:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206076288:0@lo:101: 00010000:00010000:1.0:1788625083.170774:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998882170800/0x2d2e3b3f34a7a057 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a05e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.170783:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998882170800/0x2d2e3b3f34a7a057 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a05e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625083.170880:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206076544:0@lo:501: 00000100:00100000:1.0:1788625083.170919:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625083.170951:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998845343780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625083.170983:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206076544 00000100:00100000:2.0:1788625083.170988:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206076544 00000100:00100000:2.0:1788625083.171093:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788625083.171094:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206076416 00000100:00100000:0.0:1788625083.171101:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206076416 00000100:00100000:2.0:1788625083.171103:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8417:x1875509206076544:12345-0@lo:501: 00000100:00100000:0.0:1788625083.171218:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625083.171223:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:8417:x1875509206076544:12345-0@lo:501: Request processed in 120us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625083.171232:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:3636:x1875509206076416:12345-0@lo:103: 00000100:00100000:2.0:1788625083.171234:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00010000:0.0:1788625083.171252:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788625083.171255:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206076544:0@lo:501: 00010000:00010000:0.0:1788625083.171269:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c995600/0x2d2e3b3f34a7a050 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a049 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.171283:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625083.171307:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206076672:0@lo:503: 00000100:00100000:0.0:1788625083.171325:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:3636:x1875509206076416:12345-0@lo:103: Request processed in 96us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625083.171333:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625083.171429:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206076416:0@lo:103: 00000100:00100000:1.0:1788625083.171495:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625083.171513:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998845343780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625083.171809:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206076672 00000100:00100000:2.0:1788625083.171824:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206076672 00000100:00100000:2.0:1788625083.171858:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788625083.171865:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:8417:x1875509206076672:12345-0@lo:503: 00000100:00100000:2.0:1788625083.172148:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:8417:x1875509206076672:12345-0@lo:503: Request processed in 283us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625083.172155:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788625083.173170:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206076672:0@lo:503: 00000040:00080000:1.0:1788625083.174073:0:8417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788625083.174176:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206076800:0@lo:502: 00000100:00100000:1.0:1788625083.174239:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625083.174286:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998845343780 going to sleep for 11 seconds 00000100:00100000:3.0:1788625083.174564:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206076800 00000100:00100000:3.0:1788625083.174571:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206076800 00000100:00100000:3.0:1788625083.174626:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788625083.174637:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:8417:x1875509206076800:12345-0@lo:502: 00000100:00100000:3.0:1788625083.174911:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:8417:x1875509206076800:12345-0@lo:502: Request processed in 276us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625083.174920:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788625083.174993:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206076800:0@lo:502: 00000040:00080000:1.0:1788625083.175234:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788625083.175261:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788625083.175274:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788625083.175287:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788625083.175299:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788625083.175311:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788625083.175334:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206076928:0@lo:502: 00000100:00100000:1.0:1788625083.175374:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625083.175441:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998845343780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625083.177836:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206076928 00000100:00100000:0.0:1788625083.177850:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206076928 00000100:00100000:0.0:1788625083.178100:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788625083.178113:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:8417:x1875509206076928:12345-0@lo:502: 00000100:00100000:0.0:1788625083.178311:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:8417:x1875509206076928:12345-0@lo:502: Request processed in 201us (2936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625083.178320:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788625083.178591:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206076928:0@lo:502: 00000040:00080000:3.0:1788625083.178682:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788625083.178708:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788625083.186233:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788625083.186246:0:8441:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788625083.186253:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625083.186255:0:8441:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788625083.186262:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788625083.186278:0:8441:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9988449d19c0) 00000020:00000080:1.0:1788625083.186300:0:8441:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788625083.186305:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788625083.186410:0:8441:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998878127800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788625083.186420:0:8441:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788625083.186432:0:8441:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2d2e3b3f34a7a06c 00010000:00010000:0.0:1788625083.193370:0:8441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1788625083.193729:0:8441:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788625083.198365:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788625083.199873:0:8441:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788625083.212123:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788625083.212303:0:8441:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788625083.231868:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788625083.236209:0:8441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788625083.236222:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625083.236229:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625083.236231:0:8441:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788625083.236234:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625083.236238:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625083.236239:0:8441:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788625083.236248:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788625083.236251:0:8441:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788625083.236275:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625083.236278:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625083.236279:0:8441:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788625083.236282:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788625083.236504:0:8417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788625083.236565:0:8417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788625083.236588:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882170800/0x2d2e3b3f34a7a057 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a05e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.236602:0:8417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998882170800/0x2d2e3b3f34a7a057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a05e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625083.236619:0:8417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998878127800 from 1 10000000:01000000:0.0:1788625083.236623:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788625083.236661:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c995600/0x2d2e3b3f34a7a073 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.236679:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887c995600/0x2d2e3b3f34a7a073 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.236691:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887c995600/0x2d2e3b3f34a7a073 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625083.236723:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077056:0@lo:101: 00000100:00100000:0.0:1788625083.236795:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625083.236849:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851ba3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625083.237599:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206077056 00000100:00100000:3.0:1788625083.237609:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206077056 00000100:00100000:3.0:1788625083.237651:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788625083.237659:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:8417:x1875509206077056:12345-0@lo:101: 00010000:00010000:3.0:1788625083.237673:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625083.237689:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7a07a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a073 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625083.237712:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7a07a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a073 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625083.237734:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7a07a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a073 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625083.237742:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882170c00, rc 0) 00000100:00100000:3.0:1788625083.237805:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8417:x1875509206077056:12345-0@lo:101: Request processed in 146us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625083.237822:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788625083.238141:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077056:0@lo:101: 00010000:00010000:2.0:1788625083.238156:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887c995600/0x2d2e3b3f34a7a073 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a07a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.238167:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887c995600/0x2d2e3b3f34a7a073 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a07a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625083.238282:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077184:0@lo:501: 00000100:00100000:2.0:1788625083.238312:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625083.238346:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842a879c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625083.238427:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206077184 00000100:00100000:3.0:1788625083.238432:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206077184 00000100:00100000:3.0:1788625083.238463:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788625083.238470:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8417:x1875509206077184:12345-0@lo:501: 00000100:00100000:3.0:1788625083.238599:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8417:x1875509206077184:12345-0@lo:501: Request processed in 129us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625083.238622:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788625083.238696:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077184:0@lo:501: 00000100:00100000:2.0:1788625083.238732:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077312:0@lo:503: 00000100:00100000:2.0:1788625083.238767:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625083.238784:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842a879c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625083.238913:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206077312 00000100:00100000:0.0:1788625083.238918:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206077312 00000100:00100000:0.0:1788625083.239121:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788625083.239130:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8417:x1875509206077312:12345-0@lo:503: 00000100:00100000:0.0:1788625083.239213:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8417:x1875509206077312:12345-0@lo:503: Request processed in 84us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625083.239219:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788625083.239744:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077312:0@lo:503: 00000040:00080000:2.0:1788625083.240042:0:8417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788625083.240123:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077440:0@lo:502: 00000100:00100000:2.0:1788625083.240164:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625083.240193:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842a879c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625083.242258:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206077440 00000100:00100000:3.0:1788625083.242272:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206077440 00000100:00100000:3.0:1788625083.242335:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788625083.242345:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8417:x1875509206077440:12345-0@lo:502: 00000100:00100000:3.0:1788625083.242512:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8417:x1875509206077440:12345-0@lo:502: Request processed in 167us (2346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625083.242539:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788625083.242648:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077440:0@lo:502: 00000040:00080000:3.0:1788625083.244180:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788625083.244833:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788625083.244900:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844934a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077568:0@lo:502: 00000100:00100000:3.0:1788625083.244994:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625083.247093:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866c64e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625083.247204:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206077568 00000100:00100000:0.0:1788625083.247214:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206077568 00000100:00100000:0.0:1788625083.248046:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788625083.248059:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8417:x1875509206077568:12345-0@lo:502: 00000100:00100000:3.0:1788625083.248354:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844934a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077568:0@lo:502: 00000040:00080000:3.0:1788625083.248437:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788625083.248452:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000100:00100000:0.0:1788625083.249446:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8417:x1875509206077568:12345-0@lo:502: Request processed in 172us (3234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625083.249900:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000020:01000000:3.0:1788625083.251015:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625083.251026:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625083.251029:0:8445:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788625083.251036:0:8445:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998878127800 00000020:00000080:3.0:1788625083.251039:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625083.251050:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625083.251053:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625083.251055:0:8445:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788625083.251058:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788625083.251193:0:8417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788625083.251225:0:8417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625083.251259:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c995600/0x2d2e3b3f34a7a073 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a07a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.251271:0:8417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887c995600/0x2d2e3b3f34a7a073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a07a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625083.251321:0:8417:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788625083.251324:0:8417:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998878127800 10000000:01000000:2.0:1788625083.251327:0:8417:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998878127800 10000000:01000000:2.0:1788625083.251330:0:8417:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788625083.251336:0:8417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998878127800 from 1 10000000:01000000:2.0:1788625083.251339:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788625083.251370:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac7200/0x2d2e3b3f34a7a081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.251378:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887cac7200/0x2d2e3b3f34a7a081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.251388:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887cac7200/0x2d2e3b3f34a7a081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625083.251407:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077696:0@lo:101: 00000100:00100000:2.0:1788625083.251567:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625083.251601:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788625083.252265:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206077696 00000100:00100000:0.0:1788625083.252273:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206077696 00000100:00100000:0.0:1788625083.252329:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788625083.252339:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8417:x1875509206077696:12345-0@lo:101: 00010000:00010000:0.0:1788625083.252361:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625083.252377:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c994200/0x2d2e3b3f34a7a088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a081 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.252403:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c994200/0x2d2e3b3f34a7a088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a081 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.252414:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c994200/0x2d2e3b3f34a7a088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a081 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.252423:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994200, rc 0) 00000100:00100000:0.0:1788625083.252587:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:8417:x1875509206077696:12345-0@lo:101: Request processed in 249us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625083.252594:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788625083.253789:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077696:0@lo:101: 00010000:00010000:2.0:1788625083.253826:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887cac7200/0x2d2e3b3f34a7a081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a088 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.253839:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887cac7200/0x2d2e3b3f34a7a081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a088 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625083.254187:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077824:0@lo:501: 00000100:00100000:2.0:1788625083.254233:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625083.254327:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788625083.255420:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206077824 00000100:00100000:0.0:1788625083.255430:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206077824 00000100:00100000:0.0:1788625083.255484:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788625083.255494:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:8417:x1875509206077824:12345-0@lo:501: 00000100:00100000:0.0:1788625083.255663:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:8417:x1875509206077824:12345-0@lo:501: Request processed in 170us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625083.255671:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788625083.255824:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077824:0@lo:501: 00000100:00100000:1.0:1788625083.255869:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077952:0@lo:503: 00000100:00100000:1.0:1788625083.255924:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625083.255960:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998845343600 going to sleep for 11 seconds 00000100:00100000:0.0:1788625083.256123:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206077952 00000100:00100000:0.0:1788625083.256128:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206077952 00000100:00100000:0.0:1788625083.256162:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788625083.256168:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:8417:x1875509206077952:12345-0@lo:503: 00000100:00100000:0.0:1788625083.256252:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:8417:x1875509206077952:12345-0@lo:503: Request processed in 83us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625083.256259:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788625083.256305:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206077952:0@lo:503: 00000040:00080000:0.0:1788625083.256562:0:8417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788625083.256637:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206078080:0@lo:502: 00000100:00100000:0.0:1788625083.256669:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625083.256689:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206078080 00000100:00100000:0.0:1788625083.256693:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206078080 00000100:00100000:0.0:1788625083.256710:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788625083.256715:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:8417:x1875509206078080:12345-0@lo:502: 00000100:00100000:0.0:1788625083.256782:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:8417:x1875509206078080:12345-0@lo:502: Request processed in 66us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625083.256789:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788625083.256830:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738d9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625083.256844:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206078080:0@lo:502: 00000040:00080000:0.0:1788625083.257287:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788625083.257316:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788625083.257339:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788625083.257354:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788625083.257369:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788625083.257383:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788625083.257397:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788625083.257410:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788625083.257423:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788625083.257448:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788625083.257464:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788625083.257477:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788625083.257489:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788625083.257501:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788625083.257513:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788625083.257563:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788625083.257590:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788625083.257603:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788625083.257616:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788625083.257630:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788625083.257643:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788625083.257655:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788625083.257668:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788625083.257683:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788625083.257696:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788625083.257736:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788625083.257754:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788625083.257766:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788625083.257777:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788625083.257791:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788625083.257803:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788625083.257828:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788625083.257844:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788625083.257857:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788625083.257871:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788625083.257883:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788625083.257894:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1788625083.257922:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206078208:0@lo:502: 00000100:00100000:0.0:1788625083.258354:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625083.258435:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998847f3b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788625083.258686:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206078208 00000100:00100000:1.0:1788625083.258695:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206078208 00000100:00100000:1.0:1788625083.258861:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788625083.258871:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:8417:x1875509206078208:12345-0@lo:502: 00000100:00100000:1.0:1788625083.259145:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:8417:x1875509206078208:12345-0@lo:502: Request processed in 275us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625083.259153:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788625083.259237:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206078208:0@lo:502: 00000040:00080000:2.0:1788625083.259304:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788625083.259318:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788625083.259855:0:8446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788625083.259868:0:8446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99887b488000) 00000020:00000080:2.0:1788625083.259899:0:8446:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788625083.259990:0:8446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998878127800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788625083.260004:0:8446:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998878127800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788625083.260007:0:8446:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998878127800 3 00010000:00080000:2.0:1788625083.260035:0:8446:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9988749d4800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.114@tcp at head 00010000:00010000:2.0:1788625083.261550:0:8446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788625083.261737:0:8446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788625083.261772:0:8446:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788625083.261783:0:8446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2d2e3b3f34a7a096 00000100:00080000:2.0:1788625083.261791:0:8446:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625083.261796:0:8446:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9988749d4800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625083.261848:0:8446:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998741dc3480 x1875509206078336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788625083.261875:0:8446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788625083.261978:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206078592:0@lo:400: 00000100:00100000:2.0:1788625083.262043:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625083.262082:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625083.262089:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206078464:0@lo:400: 00000100:00100000:2.0:1788625083.262115:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625083.262128:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206078336:0@lo:38: 00000100:00100000:2.0:1788625083.262148:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206078848:0@lo:400: 00000100:00100000:0.0:1788625083.262176:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625083.262182:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625083.262217:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625083.262224:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206078720:0@lo:400: 00000100:00100000:0.0:1788625083.262230:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206078464 00000100:00100000:0.0:1788625083.262237:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206078464 00000100:00100000:2.0:1788625083.262249:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625083.262277:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206078336 00000100:00100000:0.0:1788625083.262282:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206078336 00000100:00100000:2.0:1788625083.262286:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206078592 00000100:00100000:2.0:1788625083.262292:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206078592 00000100:00100000:0.0:1788625083.262296:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206078720 00000100:00100000:0.0:1788625083.262308:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206078720 00000100:00100000:2.0:1788625083.262317:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206078848 00000100:00100000:2.0:1788625083.262322:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206078848 00000100:00100000:2.0:1788625083.262341:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788625083.262347:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625083.262351:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206078592:12345-0@lo:400: 00000100:00100000:0.0:1788625083.262361:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206078464:12345-0@lo:400: 00000100:00100000:2.0:1788625083.262410:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206078592:12345-0@lo:400: Request processed in 60us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625083.262419:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206078464:12345-0@lo:400: Request processed in 61us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625083.262420:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788625083.262432:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625083.262441:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788625083.262451:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206078848:12345-0@lo:400: 00000100:00100000:0.0:1788625083.262456:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625083.262466:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206078720:12345-0@lo:400: 00000100:00100000:2.0:1788625083.262508:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206078848:12345-0@lo:400: Request processed in 59us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625083.262547:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788625083.262554:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206078720:12345-0@lo:400: Request processed in 89us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625083.262564:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788625083.262583:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788625083.264691:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998741dc0380 x1875509206078464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625083.264709:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206078464:0@lo:400: 00000100:00100000:3.0:1788625083.264794:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206078592:0@lo:400: 00000100:00100000:2.0:1788625083.265654:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875509206078336:12345-0@lo:38: 00010000:00080000:2.0:1788625083.265690:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:2.0:1788625083.265748:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2d2e3b3f34a7a09d 00000004:00100000:2.0:1788625083.265766:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788625083.265804:0:6513:0:(import.c:65:import_set_state_nolock()) ffff99886c327800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625083.265908:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875509206078336:12345-0@lo:38: Request processed in 3318us (3732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625083.265918:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788625083.266391:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998741dc3480 x1875509206078336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625083.266403:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788625083.266410:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788625083.266419:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788625083.266424:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788625083.266427:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9988749d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788625083.266433:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206078336:0@lo:38: 00010000:00080000:2.0:1788625083.266616:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998741dc1c00 x1875509206078720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625083.266628:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206078720:0@lo:400: 00000100:00100000:2.0:1788625083.266644:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206078848:0@lo:400: 00000020:01000004:3.0:1788625083.266904:0:8446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788625083.266918:0:8446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff99885e628000) 00000020:00000080:3.0:1788625083.266946:0:8446:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1788625083.267453:0:8446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998878127800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788625083.267459:0:8446:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998878127800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788625083.267461:0:8446:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998878127800 3 00010000:00080000:3.0:1788625083.267493:0:8446:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998741e0a800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.114@tcp at head 00010000:00010000:3.0:1788625083.272259:0:8446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1788625083.272540:0:8446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788625083.272587:0:8446:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788625083.272599:0:8446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2d2e3b3f34a7a0ab 00000100:00080000:3.0:1788625083.272610:0:8446:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788625083.272616:0:8446:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff998741e0a800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625083.272650:0:8446:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998844934a80 x1875509206078976/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625083.272679:0:8446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788625083.273110:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875509206078976:0@lo:38: 00000100:00100000:0.0:1788625083.273180:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788625083.273372:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788625083.273436:0:8417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788625083.273469:0:8417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788625083.273486:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac7200/0x2d2e3b3f34a7a081 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a088 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625083.273497:0:8417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887cac7200/0x2d2e3b3f34a7a081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a088 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788625083.273587:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788625083.273589:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788625083.273591:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625083.273592:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625083.273593:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625083.273594:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625083.273596:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625083.273597:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788625083.273598:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788625083.273600:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625083.273601:0:8417:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788625083.273605:0:8417:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788625083.273607:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788625083.273609:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788625083.273610:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625083.273611:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625083.273611:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625083.273613:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625083.273614:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625083.273615:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788625083.273616:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788625083.273617:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625083.273618:0:8417:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788625083.273635:0:8417:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788625083.273647:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844935880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206079104:0@lo:253: 00000100:00100000:3.0:1788625083.273684:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625083.273729:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206079104 00000100:00100000:3.0:1788625083.273736:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206079104 00000100:00100000:3.0:1788625083.273790:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788625083.273798:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:8417:x1875509206079104:12345-0@lo:253: 20000000:01000000:3.0:1788625083.273835:0:6503:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788625083.273849:0:6503:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788625083.273975:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff998858237b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625083.274422:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206078976 00000100:00100000:1.0:1788625083.274427:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206078976 00000100:00100000:1.0:1788625083.274464:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788625083.274470:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875509206078976:12345-0@lo:38: 00010000:00080000:1.0:1788625083.274492:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:1.0:1788625083.274555:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2d2e3b3f34a7a0b2 00000004:00100000:1.0:1788625083.274571:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788625083.274602:0:6512:0:(import.c:65:import_set_state_nolock()) ffff99887b613800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625083.274659:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875509206078976:12345-0@lo:38: Request processed in 188us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625083.274667:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788625083.274777:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998844934a80 x1875509206078976/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625083.274789:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788625083.274796:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788625083.274804:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788625083.274808:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788625083.274842:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998741e0a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788625083.274849:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875509206078976:0@lo:38: 20000000:01000000:3.0:1788625083.287346:0:6503:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788625083.287368:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788625083.288418:0:6527:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788625083.288424:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788625083.288448:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99887c995000/0x2d2e3b3f34a7a0b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.288466:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998859be8000/0x2d2e3b3f34a79faf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79fa8 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.288485:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998840031800/0x2d2e3b3f34a79fcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a79fc4 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.288493:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99887c995000/0x2d2e3b3f34a7a0b9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.288562:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998840031800/0x2d2e3b3f34a79fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a79fc4 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.288577:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998840031800/0x2d2e3b3f34a79fcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fc4 expref: 16 pid: 6503 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625083.288591:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875509206079232:0@lo:104: 00000100:00100000:0.0:1788625083.288666:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625083.288732:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998859be8000/0x2d2e3b3f34a79faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a79fa8 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625083.288740:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998859be8000/0x2d2e3b3f34a79faf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fa8 expref: 16 pid: 6505 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625083.288749:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875509206079360:0@lo:104: 00000100:00100000:0.0:1788625083.288770:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff998847f3b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788625083.289155:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:8417:x1875509206079104:12345-0@lo:253: Request processed in 15355us (15467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625083.289165:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788625083.289482:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788625083.289502:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625083.289551:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206079232 00000100:00100000:2.0:1788625083.289558:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206079232 00000100:00100000:2.0:1788625083.289593:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206079360 00000100:00100000:2.0:1788625083.289597:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206079360 00000100:00100000:2.0:1788625083.289610:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625083.289619:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887c8cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:6527:x1875509206079232:12345-0@lo:104: 00010000:00010000:2.0:1788625083.289634:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998882044800/0x2d2e3b3f34a79fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.289683:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625083.289688:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887c8cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:6527:x1875509206079232:12345-0@lo:104: Request processed in 71us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625083.289707:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625083.289755:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788625083.289762:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:6527:x1875509206079360:12345-0@lo:104: 00010000:00010000:2.0:1788625083.289770:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a79fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.289803:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788625083.289808:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:6527:x1875509206079360:12345-0@lo:104: Request processed in 47us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625083.289826:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788625083.289842:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625083.289848:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998882044800/0x2d2e3b3f34a79fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.289855:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882044800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625083.289859:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998882044800/0x2d2e3b3f34a79fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a79fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.289869:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998882044800/0x2d2e3b3f34a79fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a79fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625083.290150:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998882044800/0x2d2e3b3f34a79fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a79fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625083.290159:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788625083.290192:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998882044800/0x2d2e3b3f34a79fc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.290199:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625083.290222:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998882044800/0x2d2e3b3f34a79fc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.290282:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998882044800/0x2d2e3b3f34a79fc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.290297:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625083.290300:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a79fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a79faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.290305:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840030e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625083.290308:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a79fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a79faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.290314:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a79fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a79faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625083.290320:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a79fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a79faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625083.290325:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788625083.290340:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a79fa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.290345:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625083.290351:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a79fa8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.290357:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a79fa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a79faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.290370:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625083.290377:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625083.290378:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625083.290386:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625083.290413:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875509206079232:0@lo:104: 00000100:00100000:2.0:1788625083.290423:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875509206079360:0@lo:104: 00010000:00010000:2.0:1788625083.290444:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99887c995000/0x2d2e3b3f34a7a0b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625083.290585:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844935880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:8417:1875509206079104:0@lo:253: 10000000:01000000:0.0:1788625083.290595:0:8417:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788625083.290599:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788625083.290601:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788625083.290602:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625083.290604:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625083.290605:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625083.290612:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625083.290614:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788625083.290615:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788625083.290617:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788625083.290619:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625083.290621:0:8417:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788625083.290637:0:8417:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788625083.291285:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206079488:0@lo:103: 00000100:00100000:3.0:1788625083.291340:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625083.291404:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625083.291411:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206079616:0@lo:103: 00000100:00100000:3.0:1788625083.291433:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625083.292377:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206079488 00000100:00100000:1.0:1788625083.292388:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206079488 00010000:00010000:1.0:1788625083.292426:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998840031800/0x2d2e3b3f34a79fcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fc4 expref: 16 pid: 6503 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625083.292471:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206079616 00000100:00100000:1.0:1788625083.292475:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206079616 00010000:00010000:1.0:1788625083.292490:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998859be8000/0x2d2e3b3f34a79faf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fa8 expref: 17 pid: 6505 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625083.292505:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788625083.292513:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844934e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:3637:x1875509206079488:12345-0@lo:103: 00010000:00010000:1.0:1788625083.292581:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625083.292588:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998840031800/0x2d2e3b3f34a79fcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fc4 expref: 17 pid: 6503 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.292600:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998840031800/0x2d2e3b3f34a79fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fc4 expref: 17 pid: 6503 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.292617:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998840031800/0x2d2e3b3f34a79fcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fc4 expref: 17 pid: 6503 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.292632:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625083.292677:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844934e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:3637:x1875509206079488:12345-0@lo:103: Request processed in 165us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625083.292685:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788625083.292701:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788625083.292708:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844937480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:3637:x1875509206079616:12345-0@lo:103: 00010000:00010000:1.0:1788625083.292715:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625083.292720:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998859be8000/0x2d2e3b3f34a79faf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fa8 expref: 15 pid: 6505 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.292736:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998859be8000/0x2d2e3b3f34a79faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fa8 expref: 15 pid: 6505 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.292746:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be8000/0x2d2e3b3f34a79faf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a79fa8 expref: 15 pid: 6505 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.292761:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99887c995000/0x2d2e3b3f34a7a0b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.292770:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c995000/0x2d2e3b3f34a7a0b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788625083.292785:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004361819s 00010000:00010000:1.0:1788625083.292790:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887c995000/0x2d2e3b3f34a7a0b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.292797:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887c995000/0x2d2e3b3f34a7a0b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.292803:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99887c995000/0x2d2e3b3f34a7a0b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.292809:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99887c995000/0x2d2e3b3f34a7a0b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.292827:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625083.292831:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99887c995000/0x2d2e3b3f34a7a0b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.292839:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99887c995000/0x2d2e3b3f34a7a0b9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.292862:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99887c995000/0x2d2e3b3f34a7a0b9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625083.292872:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625083.292918:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844937480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:3637:x1875509206079616:12345-0@lo:103: Request processed in 211us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625083.292924:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788625083.293099:0:6527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99887c995000/0x2d2e3b3f34a7a0b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.293108:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99887c995000/0x2d2e3b3f34a7a0b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625083.293115:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c995000/0x2d2e3b3f34a7a0b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625083.294083:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206079616:0@lo:103: 00000100:00100000:3.0:1788625083.294095:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206079488:0@lo:103: 00080000:10000000:1.0:1788625083.301430:0:8417:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788625083.301642:0:8417:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788625083.301862:0:8417:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788625083.305126:0:8417:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788625083.305954:0:8417:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788625083.306664:0:8417:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788625083.310382:0:8417:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788625083.321853:0:8417:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788625083.321864:0:8417:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788625083.321908:0:8417:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788625083.321958:0:8417:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788625083.321984:0:8417:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788625083.322018:0:8417:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788625083.325355:0:8417:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625083.327223:0:8417:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788625083.471854:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625084.172017:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625084.180035:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206079744:0@lo:41: 00000100:00100000:1.0:1788625084.180150:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625084.180378:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206079744 00000100:00100000:3.0:1788625084.180391:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206079744 00000100:00100000:3.0:1788625084.180461:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788625084.180501:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206079744:12345-0@lo:41: 00000004:00000024:3.0:1788625084.180595:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788625084.180670:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206079744:12345-0@lo:41: Request processed in 171us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625084.180678:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788625084.180736:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206079744:0@lo:41: 00000020:00000004:2.0:1788625084.275127:0:8502:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788625084.275371:0:8502:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788625084.491677:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625085.519890:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625085.708085:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625085.708112:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206079872:0@lo:41: 00000100:00100000:3.0:1788625085.708182:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625085.708225:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206079872 00000100:00100000:2.0:1788625085.708234:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206079872 00000100:00100000:2.0:1788625085.708296:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625085.708306:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206079872:12345-0@lo:41: 00000004:00000024:2.0:1788625085.708337:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1788625085.708509:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206079872:12345-0@lo:41: Request processed in 202us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625085.708552:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788625085.709186:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206079872:0@lo:41: 00010000:00010000:2.0:1788625086.540173:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625087.575627:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625088.587904:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625088.782664:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206080000:0@lo:400: 00000100:00100000:3.0:1788625088.782740:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625088.782845:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206080000 00000100:00100000:0.0:1788625088.782854:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206080000 00000100:00100000:0.0:1788625088.782903:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788625088.782911:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:3637:x1875509206080000:12345-0@lo:400: 00000100:00100000:0.0:1788625088.782961:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:3637:x1875509206080000:12345-0@lo:400: Request processed in 51us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625088.782968:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788625088.783042:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206080384:0@lo:400: 00000100:00100000:1.0:1788625088.783073:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625088.783122:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788625088.783128:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206080256:0@lo:400: 00000100:00100000:1.0:1788625088.783149:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625088.783164:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206080768:0@lo:400: 00000100:00100000:1.0:1788625088.783183:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625088.783203:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206080384 00000100:00100000:1.0:1788625088.783206:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206080384 00000100:00100000:1.0:1788625088.783228:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206080768 00000100:00100000:1.0:1788625088.783230:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206080768 00000100:00100000:1.0:1788625088.783247:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788625088.783253:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206080384:12345-0@lo:400: 00000100:00100000:1.0:1788625088.783294:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206080384:12345-0@lo:400: Request processed in 41us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625088.783300:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788625088.783312:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788625088.783319:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206080768:12345-0@lo:400: 00000100:00100000:1.0:1788625088.783343:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206080768:12345-0@lo:400: Request processed in 25us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625088.783348:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788625088.783377:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742c2aa00 x1875509206080768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625088.783475:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206080000:0@lo:400: 00000100:00100000:3.0:1788625088.783482:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206080512:0@lo:400: 00000100:00100000:3.0:1788625088.783502:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625088.783549:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788625088.783555:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206080128:0@lo:400: 00000100:00100000:3.0:1788625088.783575:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625088.783592:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206080640:0@lo:400: 00000100:00100000:3.0:1788625088.783612:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625088.783641:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206080256 00000100:00100000:3.0:1788625088.783645:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206080256 00000100:00100000:3.0:1788625088.783664:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206080512 00000100:00100000:3.0:1788625088.783673:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206080512 00000100:00100000:3.0:1788625088.783690:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788625088.783695:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206080256:12345-0@lo:400: 00000100:00100000:3.0:1788625088.783738:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206080256:12345-0@lo:400: Request processed in 42us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625088.783745:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788625088.783760:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788625088.783831:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206080512:12345-0@lo:400: 00000100:00100000:3.0:1788625088.783867:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206080512:12345-0@lo:400: Request processed in 101us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625088.783873:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788625088.783891:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206080128 00000100:00100000:3.0:1788625088.783895:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206080128 00000100:00100000:3.0:1788625088.783907:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206080640 00000100:00100000:3.0:1788625088.783909:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206080640 00000100:00100000:3.0:1788625088.783923:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788625088.783928:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206080128:12345-0@lo:400: 00000100:00100000:3.0:1788625088.783956:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206080128:12345-0@lo:400: Request processed in 27us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625088.783961:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788625088.783971:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788625088.783976:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206080640:12345-0@lo:400: 00000100:00100000:3.0:1788625088.783997:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206080640:12345-0@lo:400: Request processed in 22us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625088.784002:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788625088.784016:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625088.784020:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788625088.784038:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99885eec6300 x1875509206080128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625088.784053:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206080128:0@lo:400: 00010000:00080000:3.0:1788625088.784063:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742c29500 x1875509206080640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625088.784070:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206080640:0@lo:400: 00000100:00100000:3.0:1788625088.784078:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206080512:0@lo:400: 00000100:00100000:1.0:1788625088.784481:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206080768:0@lo:400: 00010000:00080000:1.0:1788625088.784500:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99885eec4700 x1875509206080384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625088.784509:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206080384:0@lo:400: 00000100:00100000:1.0:1788625088.785543:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206080256:0@lo:400: 00000001:02000400:3.0:1788625088.856006:0:8792:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788625089.297220:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206080896:0@lo:41: 00000100:00100000:3.0:1788625089.297298:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625089.297624:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206080896 00000100:00100000:0.0:1788625089.297638:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206080896 00000100:00100000:0.0:1788625089.297698:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788625089.297709:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206080896:12345-0@lo:41: 00000004:00000024:0.0:1788625089.297743:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788625089.297798:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206080896:12345-0@lo:41: Request processed in 91us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.297807:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788625089.297834:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206080896:0@lo:41: 00010000:00010000:0.0:1788625089.612908:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788625089.701261:0:8844:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788625089.701463:0:8844:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788625089.807157:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788625089.807164:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99886c323000 from 30 10000000:01000000:3.0:1788625089.807169:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788625089.807212:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882171a00/0x2d2e3b3f34a7a0c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625089.807224:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998882171a00/0x2d2e3b3f34a7a0c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625089.807236:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998882171a00/0x2d2e3b3f34a7a0c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625089.807261:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206081024:0@lo:101: 00000100:00100000:3.0:1788625089.807329:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625089.807394:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866feacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.807630:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206081024 00000100:00100000:0.0:1788625089.807637:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206081024 00000100:00100000:0.0:1788625089.807692:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788625089.807701:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:6508:x1875509206081024:12345-0@lo:101: 00010000:00010000:0.0:1788625089.807713:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625089.807726:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c995400/0x2d2e3b3f34a7a0c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a0c0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.807765:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c995400/0x2d2e3b3f34a7a0c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a0c0 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.807776:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c995400/0x2d2e3b3f34a7a0c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a0c0 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.807786:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995400, rc 0) 00000100:00100000:0.0:1788625089.807832:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:6508:x1875509206081024:12345-0@lo:101: Request processed in 132us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.807838:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788625089.807885:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206081024:0@lo:101: 00010000:00010000:0.0:1788625089.807900:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998882171a00/0x2d2e3b3f34a7a0c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a0c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.807909:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998882171a00/0x2d2e3b3f34a7a0c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a0c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625089.807971:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206081152:0@lo:501: 00000100:00100000:0.0:1788625089.807996:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625089.808016:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885eefa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.808029:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206081152 00000100:00100000:0.0:1788625089.808032:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206081152 00000100:00100000:0.0:1788625089.808055:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788625089.808062:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:6508:x1875509206081152:12345-0@lo:501: 00000100:00100000:0.0:1788625089.808179:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:6508:x1875509206081152:12345-0@lo:501: Request processed in 117us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.808186:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788625089.808221:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206081152:0@lo:501: 00000100:00100000:0.0:1788625089.808247:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206081280:0@lo:503: 00000100:00100000:0.0:1788625089.808288:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625089.808301:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885eefa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.808312:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206081280 00000100:00100000:0.0:1788625089.808315:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206081280 00000100:00100000:0.0:1788625089.808331:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788625089.808337:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:6508:x1875509206081280:12345-0@lo:503: 00000100:00100000:0.0:1788625089.808413:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:6508:x1875509206081280:12345-0@lo:503: Request processed in 75us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.808419:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788625089.808455:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206081280:0@lo:503: 00000100:00100000:1.0:1788625089.811315:0:8852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8852:1875509206081408:0@lo:502: 00000100:00100000:1.0:1788625089.811410:0:8852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625089.811459:0:8852:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b7a1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.811555:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206081408 00000100:00100000:0.0:1788625089.811563:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206081408 00000100:00100000:0.0:1788625089.811605:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788625089.811614:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8852:x1875509206081408:12345-0@lo:502: 00000100:00100000:0.0:1788625089.811827:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8852:x1875509206081408:12345-0@lo:502: Request processed in 212us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.811835:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788625089.811981:0:8852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8852:1875509206081408:0@lo:502: 00000100:00100000:1.0:1788625089.812033:0:8852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8852:1875509206081536:0@lo:502: 00000100:00100000:1.0:1788625089.812068:0:8852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625089.812096:0:8852:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b7a1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.812150:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206081536 00000100:00100000:0.0:1788625089.812154:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206081536 00000100:00100000:0.0:1788625089.812186:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788625089.812194:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8852:x1875509206081536:12345-0@lo:502: 00000100:00100000:0.0:1788625089.812270:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:8852:x1875509206081536:12345-0@lo:502: Request processed in 76us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.812277:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788625089.812353:0:8852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8852:1875509206081536:0@lo:502: 00000040:00080000:3.0:1788625089.812374:0:8852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788625089.813037:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788625089.813060:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788625089.813070:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882171a00/0x2d2e3b3f34a7a0c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a0c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.813082:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998882171a00/0x2d2e3b3f34a7a0c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a0c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625089.813091:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788625089.813094:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99886c323000 from 5 10000000:01000000:0.0:1788625089.813097:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788625089.813124:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c994400/0x2d2e3b3f34a7a0ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.813131:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887c994400/0x2d2e3b3f34a7a0ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.813140:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887c994400/0x2d2e3b3f34a7a0ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625089.813154:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206081664:0@lo:101: 00000100:00100000:0.0:1788625089.813190:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625089.813256:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625089.815005:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206081664 00000100:00100000:3.0:1788625089.815025:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206081664 00000100:00100000:1.0:1788625089.815105:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788625089.815116:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:6508:x1875509206081664:12345-0@lo:101: 00010000:00010000:1.0:1788625089.815129:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625089.815145:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a0d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a0ce expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625089.815169:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a0d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a0ce expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625089.815180:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a0d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a0ce expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625089.815188:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be9c00, rc 0) 00000100:00100000:1.0:1788625089.815254:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206081664:12345-0@lo:101: Request processed in 140us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625089.815260:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788625089.815323:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206081664:0@lo:101: 00010000:00010000:3.0:1788625089.815341:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887c994400/0x2d2e3b3f34a7a0ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a0d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625089.815353:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887c994400/0x2d2e3b3f34a7a0ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a0d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625089.815412:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206081792:0@lo:256: 00000100:00100000:3.0:1788625089.815453:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625089.815492:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fea000 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.816935:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206081792 00000100:00100000:0.0:1788625089.816944:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206081792 00000100:00100000:0.0:1788625089.816997:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788625089.817005:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206081792:12345-0@lo:256: 20000000:01000000:0.0:1788625089.817023:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788625089.817039:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788625089.817042:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788625089.817155:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206081792:12345-0@lo:256: Request processed in 150us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.817163:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788625089.817256:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206081792:0@lo:256: 10000000:01000000:3.0:1788625089.817309:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788625089.817318:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c994400/0x2d2e3b3f34a7a0ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a0d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625089.817326:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887c994400/0x2d2e3b3f34a7a0ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a0d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625089.817334:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788625089.817336:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1788625089.817338:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788625089.817363:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882170e00/0x2d2e3b3f34a7a0dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625089.817371:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998882170e00/0x2d2e3b3f34a7a0dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625089.817389:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998882170e00/0x2d2e3b3f34a7a0dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625089.817405:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206081920:0@lo:101: 00000100:00100000:3.0:1788625089.817435:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625089.817463:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fea000 going to sleep for 11 seconds 00000100:00100000:2.0:1788625089.817560:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206081920 00000100:00100000:2.0:1788625089.817564:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206081920 00000100:00100000:2.0:1788625089.817591:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788625089.817598:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206081920:12345-0@lo:101: 00010000:00010000:2.0:1788625089.817607:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625089.817618:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887cac6200/0x2d2e3b3f34a7a0e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a0dc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625089.817636:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac6200/0x2d2e3b3f34a7a0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a0dc expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625089.817646:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887cac6200/0x2d2e3b3f34a7a0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a0dc expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625089.817653:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6200, rc 0) 00000100:00100000:2.0:1788625089.817694:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206081920:12345-0@lo:101: Request processed in 96us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.817699:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788625089.817807:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206081920:0@lo:101: 00010000:00010000:3.0:1788625089.817819:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998882170e00/0x2d2e3b3f34a7a0dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a0e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625089.817826:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998882170e00/0x2d2e3b3f34a7a0dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a0e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625089.817878:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206082048:0@lo:501: 00000100:00100000:3.0:1788625089.817904:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625089.817935:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fea000 going to sleep for 11 seconds 00000100:00100000:2.0:1788625089.818027:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206082048 00000100:00100000:2.0:1788625089.818031:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206082048 00000100:00100000:2.0:1788625089.818059:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788625089.818065:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206082048:12345-0@lo:501: 00000100:00100000:2.0:1788625089.818178:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206082048:12345-0@lo:501: Request processed in 113us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.818194:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788625089.818337:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206082048:0@lo:501: 00000100:00100000:3.0:1788625089.818365:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206082176:0@lo:503: 00000100:00100000:3.0:1788625089.818403:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625089.818426:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fea000 going to sleep for 11 seconds 00000100:00100000:2.0:1788625089.818464:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206082176 00000100:00100000:2.0:1788625089.818468:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206082176 00000100:00100000:2.0:1788625089.818496:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788625089.818502:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206082176:12345-0@lo:503: 00000100:00100000:2.0:1788625089.818638:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206082176:12345-0@lo:503: Request processed in 136us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.818645:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788625089.818835:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206082176:0@lo:503: 00000100:00100000:3.0:1788625089.819141:0:8854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8854:1875509206082304:0@lo:502: 00000100:00100000:3.0:1788625089.819177:0:8854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625089.819211:0:8854:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fea180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625089.819250:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206082304 00000100:00100000:2.0:1788625089.819255:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206082304 00000100:00100000:2.0:1788625089.819289:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788625089.819296:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:8854:x1875509206082304:12345-0@lo:502: 00000100:00100000:2.0:1788625089.819892:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:8854:x1875509206082304:12345-0@lo:502: Request processed in 594us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.819899:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788625089.821728:0:8854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8854:1875509206082304:0@lo:502: 00000020:01000000:0.0:1788625089.821776:0:8854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788625089.821785:0:8854:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788625089.822281:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625089.822284:0:8854:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788625089.822294:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788625089.822298:0:8854:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:01000000:0.0:1788625089.822322:0:8854:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788625089.822325:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625089.822352:0:8854:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff99887cb1b380) 00000020:00000080:0.0:1788625089.822376:0:8854:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788625089.822382:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788625089.822466:0:8854:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788625089.822473:0:8854:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788625089.822481:0:8854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a7a0f1 00010000:00080000:0.0:1788625089.822511:0:8854:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9987424e0800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.114@tcp at head 00010000:00010000:0.0:1788625089.822752:0:8854:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788625089.847058:0:8854:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788625089.847085:0:8854:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788625089.847355:0:8854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625089.847559:0:8854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625089.847641:0:8854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788625089.847741:0:8854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788625089.850552:0:8858:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788625089.850561:0:8858:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788625089.854832:0:8854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788625089.854850:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788625089.854908:0:8854:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788625089.854936:0:8854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7a0f8 00000100:00080000:2.0:1788625089.854948:0:8854:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625089.854955:0:8854:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9987424e0800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625089.854994:0:8854:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998741dc0700 x1875509206082432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788625089.855027:0:8854:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788625089.855100:0:8854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625089.855104:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625089.855106:0:8854:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788625089.855116:0:8854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625089.855120:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625089.855122:0:8854:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788625089.855125:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788625089.855128:0:8854:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788625089.855157:0:8854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8854:1875509206082560:0@lo:502: 00000100:00100000:2.0:1788625089.855235:0:8854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625089.855282:0:8854:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788625089.855381:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206082560 00000100:00100000:2.0:1788625089.855387:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206082560 00000100:00100000:2.0:1788625089.855429:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788625089.855438:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:8854:x1875509206082560:12345-0@lo:502: 00000100:00100000:2.0:1788625089.855566:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:8854:x1875509206082560:12345-0@lo:502: Request processed in 129us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.855574:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788625089.855614:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206082688:0@lo:400: 00000100:00100000:2.0:1788625089.855643:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625089.855663:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206083200:0@lo:400: 00000100:00100000:2.0:1788625089.855699:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625089.855720:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625089.855726:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206082816:0@lo:400: 00000100:00100000:2.0:1788625089.855750:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625089.855780:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206082944:0@lo:400: 00000100:00100000:2.0:1788625089.855802:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625089.855820:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625089.855825:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206083072:0@lo:400: 00000100:00100000:2.0:1788625089.855844:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625089.855878:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206082688 00000100:00100000:2.0:1788625089.855882:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206082688 00000100:00100000:2.0:1788625089.855903:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206083200 00000100:00100000:2.0:1788625089.855906:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206083200 00000100:00100000:2.0:1788625089.855918:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206082944 00000100:00100000:2.0:1788625089.855921:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206082944 00000100:00100000:2.0:1788625089.855930:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206083072 00000100:00100000:2.0:1788625089.855932:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206083072 00000100:00100000:2.0:1788625089.855944:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788625089.855950:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206082688:12345-0@lo:400: 00000100:00100000:2.0:1788625089.855985:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206082688:12345-0@lo:400: Request processed in 36us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.855991:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788625089.856004:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788625089.856010:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206083200:12345-0@lo:400: 00000100:00100000:2.0:1788625089.856037:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206083200:12345-0@lo:400: Request processed in 27us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.856043:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788625089.856054:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788625089.856059:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206082944:12345-0@lo:400: 00000100:00100000:0.0:1788625089.856079:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206082432:0@lo:8: 00000100:00100000:2.0:1788625089.856087:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206082944:12345-0@lo:400: Request processed in 29us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.856092:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788625089.856104:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625089.856109:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206083072:12345-0@lo:400: 00000100:00100000:0.0:1788625089.856123:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625089.856132:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206083072:12345-0@lo:400: Request processed in 23us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.856137:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625089.856162:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206082816 00000100:00100000:2.0:1788625089.856166:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206082816 00000100:00100000:2.0:1788625089.856197:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788625089.856204:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206082816:12345-0@lo:400: 00000100:00100000:2.0:1788625089.856246:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206082816:12345-0@lo:400: Request processed in 41us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.856252:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788625089.856287:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206082816:0@lo:400: 00010000:00080000:2.0:1788625089.856298:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998741dc3800 x1875509206082688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625089.856308:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206082688:0@lo:400: 00010000:00080000:2.0:1788625089.856317:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998741dc1180 x1875509206083200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625089.856325:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206083200:0@lo:400: 00010000:00080000:2.0:1788625089.856354:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998741dc1880 x1875509206083072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625089.856361:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206083072:0@lo:400: 00010000:00080000:2.0:1788625089.856370:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998741dc1500 x1875509206082944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625089.856376:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206082944:0@lo:400: 00000100:00100000:2.0:1788625089.856397:0:8854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8854:1875509206082560:0@lo:502: 00000020:01000000:2.0:1788625089.856420:0:8854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625089.856425:0:8854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625089.856426:0:8854:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788625089.856436:0:8854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1788625089.856550:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1788625089.856569:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788625089.856578:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882170e00/0x2d2e3b3f34a7a0dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a0e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.856599:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998882170e00/0x2d2e3b3f34a7a0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a0e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625089.856609:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788625089.856611:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998852348000 from 30 10000000:01000000:0.0:1788625089.856614:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788625089.856639:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c994600/0x2d2e3b3f34a7a0ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.856647:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887c994600/0x2d2e3b3f34a7a0ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.856655:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887c994600/0x2d2e3b3f34a7a0ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625089.856669:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206083328:0@lo:101: 00000100:00100000:3.0:1788625089.856948:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206082432 00000100:00100000:3.0:1788625089.856955:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206082432 00000100:00100000:3.0:1788625089.856992:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625089.857009:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875509206082432:12345-0@lo:8: 00010000:00080000:3.0:1788625089.857031:0:8423:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1788625089.857071:0:8423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7a106 00002000:00100000:3.0:1788625089.857111:0:8423:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff998741e0a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788625089.857116:0:8423:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1788625089.857120:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788625089.857182:0:8423:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788625089.857451:0:8423:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788625089.857475:0:8423:0:(import.c:65:import_set_state_nolock()) ffff998741e08800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625089.857602:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625089.857647:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269fa80 going to sleep for 11 seconds 00010000:00080000:0.0:1788625089.857690:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998741dc0700 x1875509206082432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625089.857700:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788625089.857707:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788625089.857715:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788625089.857720:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788625089.857723:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9987424e0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788625089.857733:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788625089.857738:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206082432:0@lo:8: 00000004:00080000:0.0:1788625089.857770:0:8858:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788625089.857825:0:8858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 210965307367ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788625089.857831:0:8858:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788625089.857848:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1875509206082432:12345-0@lo:8: Request processed in 836us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625089.857856:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625089.857921:0:8860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1875509206083456:0@lo:700: 00000100:00100000:3.0:1788625089.857958:0:8860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625089.858290:0:8860:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fead80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.858375:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206083456 00000100:00100000:0.0:1788625089.858381:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206083456 00000100:00100000:0.0:1788625089.858425:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625089.858433:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8860:x1875509206083456:12345-0@lo:700: 00000100:00100000:0.0:1788625089.858467:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8432:1875509206083584:0@lo:700: 00000100:00100000:0.0:1788625089.858495:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625089.858511:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269f240 going to sleep for 11 seconds 00000100:00080000:3.0:1788625089.858622:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625089.858653:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206083584 00000100:00100000:0.0:1788625089.858658:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206083584 00000100:00100000:0.0:1788625089.858697:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788625089.858704:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8432:x1875509206083584:12345-0@lo:700: 00000100:00100000:2.0:1788625089.858898:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206083328 00000100:00100000:2.0:1788625089.858902:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206083328 00000100:00100000:0.0:1788625089.859760:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788625089.859773:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206083328:12345-0@lo:101: 00010000:00010000:0.0:1788625089.859785:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625089.859803:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c995e00/0x2d2e3b3f34a7a10d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a0ff expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.859831:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c995e00/0x2d2e3b3f34a7a10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a0ff expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.859844:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c995e00/0x2d2e3b3f34a7a10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a0ff expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.859854:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995e00, rc 0) 00000100:00100000:0.0:1788625089.859907:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206083328:12345-0@lo:101: Request processed in 138us (2305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.859933:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788625089.859995:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206083328:0@lo:101: 00010000:00010000:0.0:1788625089.860019:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887c994600/0x2d2e3b3f34a7a0ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a10d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.860028:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887c994600/0x2d2e3b3f34a7a0ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a10d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625089.860092:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206083712:0@lo:501: 00000100:00100000:0.0:1788625089.860124:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625089.860154:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206083712 00000100:00100000:3.0:1788625089.860159:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206083712 00000100:00100000:3.0:1788625089.860185:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788625089.860192:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206083712:12345-0@lo:501: 00000100:00100000:0.0:1788625089.860205:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625089.860448:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206083712:12345-0@lo:501: Request processed in 256us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625089.860454:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788625089.860465:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206083712:0@lo:501: 00000100:00100000:0.0:1788625089.860567:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206083840:0@lo:503: 00000100:00100000:0.0:1788625089.860602:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625089.860617:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.860631:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206083840 00000100:00100000:0.0:1788625089.860634:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206083840 00000100:00100000:0.0:1788625089.860671:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788625089.860692:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206083840:12345-0@lo:503: 00000100:00100000:0.0:1788625089.860776:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206083840:12345-0@lo:503: Request processed in 98us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.860784:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788625089.860821:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206083840:0@lo:503: 00000100:00100000:3.0:1788625089.861057:0:8861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8861:1875509206083968:0@lo:502: 00000100:00100000:3.0:1788625089.861095:0:8861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625089.861123:0:8861:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fea300 going to sleep for 11 seconds 00000100:00100000:2.0:1788625089.861188:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206083968 00000100:00100000:2.0:1788625089.861209:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206083968 00000100:00100000:0.0:1788625089.861344:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788625089.861351:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:8861:x1875509206083968:12345-0@lo:502: 00000100:00100000:0.0:1788625089.861422:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:8861:x1875509206083968:12345-0@lo:502: Request processed in 71us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.861428:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788625089.861461:0:8861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8861:1875509206083968:0@lo:502: 00000004:00080000:2.0:1788625089.861480:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788625089.861550:0:8861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8861:1875509206084096:0@lo:502: 00000100:00100000:3.0:1788625089.861590:0:8861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625089.861612:0:8861:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fea300 going to sleep for 11 seconds 00000100:00100000:2.0:1788625089.862018:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206084096 00000100:00100000:2.0:1788625089.862024:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206084096 00000100:00100000:2.0:1788625089.862058:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788625089.862066:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:8861:x1875509206084096:12345-0@lo:502: 00000100:00100000:2.0:1788625089.862146:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:8861:x1875509206084096:12345-0@lo:502: Request processed in 82us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.862155:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788625089.862184:0:8861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8861:1875509206084096:0@lo:502: 00000040:00080000:3.0:1788625089.862208:0:8861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788625089.862317:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788625089.862335:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788625089.862342:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c994600/0x2d2e3b3f34a7a0ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a10d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.862349:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887c994600/0x2d2e3b3f34a7a0ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a10d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625089.862355:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788625089.862358:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998852348000 from 5 10000000:01000000:0.0:1788625089.862359:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788625089.862378:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c995a00/0x2d2e3b3f34a7a114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.862383:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887c995a00/0x2d2e3b3f34a7a114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.862389:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887c995a00/0x2d2e3b3f34a7a114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625089.862398:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206084224:0@lo:101: 00000100:00100000:0.0:1788625089.862420:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625089.862443:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625089.862585:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206084224 00000100:00100000:2.0:1788625089.862590:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206084224 00000100:00100000:2.0:1788625089.862614:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788625089.862622:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206084224:12345-0@lo:101: 00010000:00010000:2.0:1788625089.862629:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625089.862641:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a11b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a114 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625089.862661:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a11b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a114 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625089.862671:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a11b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a114 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625089.862691:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6000, rc 0) 00000100:00100000:2.0:1788625089.862733:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:6508:x1875509206084224:12345-0@lo:101: Request processed in 111us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.862757:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788625089.862842:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206084224:0@lo:101: 00010000:00010000:3.0:1788625089.862853:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887c995a00/0x2d2e3b3f34a7a114 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a11b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625089.862864:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887c995a00/0x2d2e3b3f34a7a114 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a11b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625089.862900:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206084352:0@lo:256: 00000100:00100000:3.0:1788625089.862924:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625089.862950:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fea300 going to sleep for 11 seconds 00000100:00100000:2.0:1788625089.863449:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206084352 00000100:00100000:2.0:1788625089.863453:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206084352 00000100:00100000:2.0:1788625089.863482:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788625089.863490:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:6508:x1875509206084352:12345-0@lo:256: 20000000:01000000:2.0:1788625089.863505:0:6503:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788625089.863550:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788625089.863554:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788625089.863647:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:6508:x1875509206084352:12345-0@lo:256: Request processed in 157us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.863655:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788625089.863665:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206084352:0@lo:256: 10000000:01000000:3.0:1788625089.863725:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788625089.863731:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c995a00/0x2d2e3b3f34a7a114 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a11b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625089.863744:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887c995a00/0x2d2e3b3f34a7a114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a11b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625089.863927:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788625089.863929:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788625089.863932:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788625089.863963:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682200/0x2d2e3b3f34a7a122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625089.863972:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b682200/0x2d2e3b3f34a7a122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625089.863980:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b682200/0x2d2e3b3f34a7a122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625089.863993:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206084480:0@lo:101: 00000100:00100000:3.0:1788625089.864022:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625089.864049:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fea300 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.864217:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206084480 00000100:00100000:0.0:1788625089.864222:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206084480 00000100:00100000:0.0:1788625089.864257:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788625089.864264:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:6508:x1875509206084480:12345-0@lo:101: 00010000:00010000:0.0:1788625089.864279:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625089.864291:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a122 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.864308:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a122 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.864318:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a122 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.864326:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994c00, rc 0) 00000100:00100000:0.0:1788625089.864367:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206084480:12345-0@lo:101: Request processed in 103us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.864373:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788625089.864451:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206084480:0@lo:101: 00010000:00010000:2.0:1788625089.864463:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b682200/0x2d2e3b3f34a7a122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a129 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625089.864472:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b682200/0x2d2e3b3f34a7a122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a129 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625089.864550:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206084608:0@lo:501: 00000100:00100000:2.0:1788625089.864575:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625089.864599:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.864714:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206084608 00000100:00100000:0.0:1788625089.864719:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206084608 00000100:00100000:0.0:1788625089.864755:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788625089.864762:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206084608:12345-0@lo:501: 00000100:00100000:0.0:1788625089.864897:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206084608:12345-0@lo:501: Request processed in 133us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.864905:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788625089.864909:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206084608:0@lo:501: 00000100:00100000:2.0:1788625089.864947:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206084736:0@lo:503: 00000100:00100000:2.0:1788625089.864985:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625089.865003:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.865028:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206084736 00000100:00100000:0.0:1788625089.865032:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206084736 00000100:00100000:0.0:1788625089.865057:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788625089.865065:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206084736:12345-0@lo:503: 00000100:00100000:0.0:1788625089.865222:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206084736:12345-0@lo:503: Request processed in 158us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.865231:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788625089.865255:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206084736:0@lo:503: 00000100:00100000:2.0:1788625089.865722:0:8862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8862:1875509206084864:0@lo:502: 00000100:00100000:2.0:1788625089.865756:0:8862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625089.865774:0:8862:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433bf600 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.865833:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206084864 00000100:00100000:0.0:1788625089.865839:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206084864 00000100:00100000:0.0:1788625089.865871:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788625089.865878:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:8862:x1875509206084864:12345-0@lo:502: 00000100:00100000:0.0:1788625089.865979:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:8862:x1875509206084864:12345-0@lo:502: Request processed in 101us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.865986:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788625089.866010:0:8862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8862:1875509206084864:0@lo:502: 00000020:01000000:2.0:1788625089.866036:0:8862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788625089.866045:0:8862:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788625089.866052:0:8862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625089.866055:0:8862:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788625089.866061:0:8862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788625089.866065:0:8862:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:01000000:2.0:1788625089.866092:0:8862:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788625089.866096:0:8862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788625089.866112:0:8862:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99887b4899c0) 00000020:00000080:2.0:1788625089.866150:0:8862:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788625089.866157:0:8862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788625089.866253:0:8862:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788625089.866260:0:8862:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788625089.866267:0:8862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7a137 00010000:00080000:2.0:1788625089.866299:0:8862:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99887393d000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.114@tcp at head 40000000:02000000:2.0:1788625089.866452:0:6518:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1788625089.872766:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8432:x1875509206083584:12345-0@lo:700: Request processed in 14054us (14262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.872785:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788625089.873052:0:8862:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00010000:00080000:3.0:1788625089.873954:0:8432:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742c2a680 x1875509206083584/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788625105 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625089.873971:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8432:1875509206083584:0@lo:700: 40000000:02000000:3.0:1788625089.873987:0:8432:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:1.0:1788625089.880826:0:8862:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788625089.881201:0:8862:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788625089.882360:0:8862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00100000:3.0:1788625089.882404:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788625089.882568:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8860:x1875509206083456:12345-0@lo:700: Request processed in 24130us (24603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625089.882589:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1788625089.882625:0:8862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:3.0:1788625089.882666:0:8860:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99885eec7b80 x1875509206083456/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788625105 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625089.882704:0:8860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1875509206083456:0@lo:700: 00000040:00080000:1.0:1788625089.882743:0:8862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788625089.882866:0:8862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788625089.883625:0:8864:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788625089.883630:0:8864:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788625089.884725:0:8862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788625089.884735:0:8862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788625089.884857:0:8862:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788625089.884876:0:8862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7a13e 00000100:00080000:2.0:1788625089.884888:0:8862:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625089.884893:0:8862:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99887393d000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625089.884920:0:8862:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998741dc0e00 x1875509206084992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788625089.884944:0:8862:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788625089.884978:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206084992:0@lo:8: 00000020:01000000:2.0:1788625089.885004:0:8862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625089.885008:0:8862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625089.885010:0:8862:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788625089.885012:0:8862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625089.885016:0:8862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625089.885017:0:8862:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788625089.885021:0:8862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788625089.885022:0:8862:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788625089.885042:0:8862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8862:1875509206085120:0@lo:502: 00000100:00100000:0.0:1788625089.885048:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625089.885091:0:8862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625089.885106:0:8862:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433bf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.885195:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206085120 00000100:00100000:0.0:1788625089.885201:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206085120 00000100:00100000:0.0:1788625089.885248:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788625089.885262:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:8862:x1875509206085120:12345-0@lo:502: 00000100:00100000:3.0:1788625089.885277:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206084992 00000100:00100000:3.0:1788625089.885284:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206084992 00000100:00100000:3.0:1788625089.885322:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625089.885329:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875509206084992:12345-0@lo:8: 00010000:00080000:3.0:1788625089.885354:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000100:00100000:0.0:1788625089.885376:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:8862:x1875509206085120:12345-0@lo:502: Request processed in 118us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.885384:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788625089.885388:0:8862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:8862:1875509206085120:0@lo:502: 00000020:01000000:2.0:1788625089.885416:0:8862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625089.885429:0:8862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625089.885430:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7a145 00000020:00000080:2.0:1788625089.885431:0:8862:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788625089.885438:0:8862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00002000:00100000:3.0:1788625089.885449:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff998741e0f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788625089.885456:0:8425:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788625089.885459:0:8425:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:2.0:1788625089.885498:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00002000:00080000:3.0:1788625089.885563:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788625089.885591:0:8425:0:(import.c:65:import_set_state_nolock()) ffff998741e0c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625089.885641:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1875509206084992:12345-0@lo:8: Request processed in 311us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625089.885649:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:2.0:1788625089.886035:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788625089.886045:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682200/0x2d2e3b3f34a7a122 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a129 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625089.886054:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b682200/0x2d2e3b3f34a7a122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a129 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625089.886065:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788625089.886075:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99885ecd99c0 from 1 00010000:00080000:0.0:1788625089.886079:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998741dc0e00 x1875509206084992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788625089.886080:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:0.0:1788625089.886091:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788625089.886098:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00010000:00010000:2.0:1788625089.886110:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac7600/0x2d2e3b3f34a7a14c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625089.886119:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887cac7600/0x2d2e3b3f34a7a14c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625089.886128:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887cac7600/0x2d2e3b3f34a7a14c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625089.886143:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206085248:0@lo:101: 00000100:00080000:0.0:1788625089.886162:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788625089.886168:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788625089.886171:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887393d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788625089.886190:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788625089.886190:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788625089.886198:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206084992:0@lo:8: 00000004:00080000:3.0:1788625089.886217:0:8864:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788625089.886232:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206085248 00000100:00100000:0.0:1788625089.886237:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206085248 00000100:00100000:2.0:1788625089.886242:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433bf9c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788625089.886276:0:8864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 210993757333ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788625089.886281:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00080000:00080000:3.0:1788625089.886286:0:8864:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788625089.886291:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206085248:12345-0@lo:101: 00010000:00010000:0.0:1788625089.886300:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625089.886313:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c995800/0x2d2e3b3f34a7a153 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a14c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.886335:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c995800/0x2d2e3b3f34a7a153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a14c expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.886346:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c995800/0x2d2e3b3f34a7a153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a14c expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.886354:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995800, rc 0) 00000100:00100000:0.0:1788625089.886396:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206085248:12345-0@lo:101: Request processed in 108us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.886402:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788625089.886447:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206085248:0@lo:101: 00010000:00010000:0.0:1788625089.886462:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887cac7600/0x2d2e3b3f34a7a14c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a153 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.886471:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887cac7600/0x2d2e3b3f34a7a14c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a153 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625089.886549:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206085376:0@lo:501: 00000100:00100000:0.0:1788625089.886589:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625089.886616:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884885acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.886632:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206085376 00000100:00100000:0.0:1788625089.886635:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206085376 00000100:00100000:0.0:1788625089.886806:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788625089.886821:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206085376:12345-0@lo:501: 00000100:00100000:0.0:1788625089.886884:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206085376:12345-0@lo:501: Request processed in 65us (305us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788625089.886901:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788625089.886941:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206085376:0@lo:501: 10000000:01000000:0.0:1788625089.886970:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788625089.886976:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac7600/0x2d2e3b3f34a7a14c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a153 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625089.886983:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887cac7600/0x2d2e3b3f34a7a14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a153 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788625089.888163:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788625089.888298:0:8865:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788625089.888313:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206085504:0@lo:13: 00000100:00100000:0.0:1788625089.888319:0:8865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8865:1875509206085632:0@lo:7: 00000100:00100000:0.0:1788625089.888369:0:8865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625089.888371:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625089.888398:0:8865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.888423:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206085632 00000100:00100000:0.0:1788625089.888428:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206085632 00000100:00100000:2.0:1788625089.888432:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206085504 00000100:00100000:2.0:1788625089.888438:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206085504 00000100:00100000:2.0:1788625089.888483:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625089.888484:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625089.888499:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875509206085504:12345-0@lo:13: 00000100:00100000:0.0:1788625089.888499:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8865:x1875509206085632:12345-0@lo:7: 00002000:00000024:2.0:1788625089.888560:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788625089.888607:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875509206085504:12345-0@lo:13: Request processed in 114us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.888614:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788625089.888649:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742c2a300 x1875509206085504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625089.888667:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206085504:0@lo:13: 00000100:00080000:3.0:1788625089.890623:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788625089.891997:0:8860:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788625089.892030:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625089.892037:0:8860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1875509206085888:0@lo:7: 00000100:00100000:1.0:1788625089.892049:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206085760:0@lo:13: 00000100:00100000:2.0:1788625089.892121:0:8860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625089.892121:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625089.892167:0:8860:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433bf600 going to sleep for 11 seconds 00000100:00100000:3.0:1788625089.892168:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788625089.892178:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788625089.892179:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206085760 00000100:00100000:1.0:1788625089.892188:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206085760 00000100:00100000:1.0:1788625089.892243:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788625089.892255:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206085760:12345-0@lo:13: 00002000:00000024:1.0:1788625089.892275:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1788625089.892349:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206085760:12345-0@lo:13: Request processed in 97us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625089.892350:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206085888 00000100:00100000:3.0:1788625089.892356:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206085888 00000100:00100000:1.0:1788625089.892361:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788625089.892408:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998741dc1180 x1875509206085760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625089.892427:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206085760:0@lo:13: 00000100:00100000:2.0:1788625089.892460:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625089.892469:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8860:x1875509206085888:12345-0@lo:7: 00002000:00080000:0.0:1788625089.893212:0:8424:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788625089.893219:0:8424:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788625089.893266:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8865:x1875509206085632:12345-0@lo:7: Request processed in 4772us (4900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.893274:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788625089.893307:0:8865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742c29f80 x1875509206085632/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788625105 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625089.893319:0:8865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8865:1875509206085632:0@lo:7: 00000004:00080000:1.0:1788625089.893331:0:8865:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788625089.893362:0:8865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449aea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8865:1875509206086016:0@lo:5: 00000100:00100000:1.0:1788625089.893393:0:8865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625089.893420:0:8865:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b7a1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.893850:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206086016 00000100:00100000:0.0:1788625089.893856:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206086016 00000100:00100000:0.0:1788625089.893899:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625089.893910:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8865:x1875509206086016:12345-0@lo:5: 00002000:00080000:0.0:1788625089.893934:0:8425:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788625089.893937:0:8425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00002000:00080000:2.0:1788625089.898275:0:8868:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788625089.898284:0:8868:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788625089.898377:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8860:x1875509206085888:12345-0@lo:7: Request processed in 5906us (6260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.898389:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788625089.898416:0:8860:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998741dc3800 x1875509206085888/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788625105 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625089.898432:0:8860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1875509206085888:0@lo:7: 00000004:00080000:1.0:1788625089.898448:0:8860:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788625089.898494:0:8860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1875509206086144:0@lo:5: 00000100:00100000:1.0:1788625089.898625:0:8860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625089.898657:0:8860:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b7a1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.898857:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206086144 00000100:00100000:0.0:1788625089.898864:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206086144 00000100:00100000:0.0:1788625089.898911:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788625089.898921:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8860:x1875509206086144:12345-0@lo:5: 00002000:00080000:0.0:1788625089.898945:0:8424:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788625089.898985:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8860:x1875509206086144:12345-0@lo:5: Request processed in 66us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.898991:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788625089.899018:0:8860:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9988449ae300 x1875509206086144/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625105 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625089.899028:0:8860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1875509206086144:0@lo:5: 00000004:00080000:0.0:1788625089.899037:0:8860:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788625089.899066:0:8860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1875509206086272:0@lo:5: 00000100:00100000:0.0:1788625089.899088:0:8860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625089.899102:0:8860:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.899113:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206086272 00000100:00100000:0.0:1788625089.899117:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206086272 00000100:00100000:0.0:1788625089.899147:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788625089.899153:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8860:x1875509206086272:12345-0@lo:5: 00002000:00080000:0.0:1788625089.899175:0:8424:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000001:00080000:3.0:1788625089.903070:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788625089.903096:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788625089.903296:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8865:x1875509206086016:12345-0@lo:5: Request processed in 9384us (9897us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788625089.903307:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788625089.903375:0:8865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9988449aea00 x1875509206086016/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625105 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625089.903389:0:8865:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788625089.903396:0:8865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449aea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8865:1875509206086016:0@lo:5: 00000004:00080000:1.0:1788625089.903412:0:8865:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788625089.903472:0:8865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449aea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8865:1875509206086400:0@lo:700: 00000100:00100000:1.0:1788625089.903514:0:8865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625089.903556:0:8865:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b7a1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625089.903886:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206086400 00000100:00100000:0.0:1788625089.903893:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206086400 00000100:00100000:0.0:1788625089.903932:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788625089.903940:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8865:x1875509206086400:12345-0@lo:700: 00010000:00080000:0.0:1788625089.907873:0:8860:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742c2bb80 x1875509206086272/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625105 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625089.907874:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8860:x1875509206086272:12345-0@lo:5: Request processed in 8712us (8775us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788625089.907899:0:8860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1875509206086272:0@lo:5: 00000100:00100000:2.0:1788625089.907900:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788625089.907914:0:8860:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788625089.907950:0:8860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8860:1875509206086528:0@lo:900: 00000100:00100000:0.0:1788625089.908032:0:8860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625089.908068:0:8860:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625089.908574:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206086528 00000100:00100000:2.0:1788625089.908581:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206086528 00000100:00100000:2.0:1788625089.908629:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625089.908639:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8860:x1875509206086528:12345-0@lo:900: 00000100:00100000:2.0:1788625089.908710:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8860:x1875509206086528:12345-0@lo:900: Request processed in 73us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625089.908717:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788625089.908847:0:8860:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742c28700 x1875509206086528/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788625105 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625089.908858:0:8860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8860:1875509206086528:0@lo:900: 00000001:00080000:1.0:1788625089.918327:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:0.0:1788625089.918745:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8865:x1875509206086400:12345-0@lo:700: Request processed in 14800us (15225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625089.918758:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788625089.918909:0:8865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9988449aea00 x1875509206086400/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788625105 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625089.918924:0:8865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449aea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8865:1875509206086400:0@lo:700: 00000004:02000040:0.0:1788625089.920984:0:8865:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1788625089.925009:0:8865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8865:1875509206086656:0@lo:5: 00000100:00100000:0.0:1788625089.925077:0:8865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625089.925135:0:8865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788625089.925214:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206086656 00000100:00100000:1.0:1788625089.925222:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206086656 00000100:00100000:1.0:1788625089.925288:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625089.925298:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8865:x1875509206086656:12345-0@lo:5: 00002000:00080000:1.0:1788625089.931034:0:8423:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788625089.931056:0:8423:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788625089.933119:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8865:x1875509206086656:12345-0@lo:5: Request processed in 7817us (8035us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788625089.933133:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788625089.933235:0:8865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742c28700 x1875509206086656/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625105 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625089.933255:0:8865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8865:1875509206086656:0@lo:5: 00000004:00080000:2.0:1788625089.933271:0:8865:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000001:00080000:1.0:1788625090.461847:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1788625090.636046:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625090.831314:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206086784:0@lo:41: 00000100:00100000:1.0:1788625090.831626:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625090.831860:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206086784 00000100:00100000:0.0:1788625090.831869:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206086784 00000100:00100000:0.0:1788625090.832083:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788625090.832093:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206086784:12345-0@lo:41: 00000004:00000024:0.0:1788625090.832144:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788625090.832224:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206086784:12345-0@lo:41: Request processed in 132us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625090.832232:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788625090.832309:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206086784:0@lo:41: 00010000:00010000:1.0:1788625091.659726:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788625092.260323:0:8954:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625092.260561:0:8954:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788625092.685906:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788625093.049484:0:9003:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788625093.049496:0:9003:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1788625093.708115:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625094.419879:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625094.419916:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206086912:0@lo:41: 00000100:00100000:0.0:1788625094.420023:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625094.420335:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206086912 00000100:00100000:3.0:1788625094.420346:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206086912 00000100:00100000:3.0:1788625094.420411:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788625094.420422:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206086912:12345-0@lo:41: 00000004:00000024:3.0:1788625094.420468:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788625094.420599:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206086912:12345-0@lo:41: Request processed in 167us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625094.420675:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788625094.420808:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206086912:0@lo:41: 00010000:00010000:2.0:1788625094.732971:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625094.924701:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206087040:0@lo:13: 00000100:00100000:0.0:1788625094.924704:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206087168:0@lo:13: 00000100:00100000:0.0:1788625094.924807:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625094.924856:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206087168 00000100:00100000:2.0:1788625094.924865:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206087168 00000100:00100000:0.0:1788625094.924888:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625094.924929:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206087040 00000100:00100000:2.0:1788625094.924932:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206087040 00000100:00100000:2.0:1788625094.924958:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625094.924968:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206087168:12345-0@lo:13: 00002000:00000024:2.0:1788625094.925016:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625094.925062:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206087680:0@lo:400: 00000100:00100000:1.0:1788625094.925097:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625094.925120:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788625094.925126:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206087296:0@lo:400: 00000100:00100000:2.0:1788625094.925134:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206087168:12345-0@lo:13: Request processed in 168us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625094.925142:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788625094.925160:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625094.925161:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625094.925167:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206087040:12345-0@lo:13: 00002000:00000024:2.0:1788625094.925177:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625094.925188:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206087808:0@lo:400: 00000100:00100000:2.0:1788625094.925197:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206087040:12345-0@lo:13: Request processed in 31us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625094.925203:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625094.925211:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788625094.925220:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625094.925232:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206087680 00000100:00100000:2.0:1788625094.925235:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206087680 00010000:00080000:1.0:1788625094.925248:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742c2a300 x1875509206087168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625094.925261:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788625094.925262:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788625094.925267:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206087680:12345-0@lo:400: 00000100:00100000:1.0:1788625094.925299:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206087168:0@lo:13: 00010000:00080000:1.0:1788625094.925329:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742c5d880 x1875509206087680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625094.925338:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206087680:0@lo:400: 00000100:00100000:0.0:1788625094.925660:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206087296 00000100:00100000:0.0:1788625094.925666:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206087296 00000100:00100000:0.0:1788625094.925713:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788625094.925723:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:3635:x1875509206087296:12345-0@lo:400: 00000100:00100000:1.0:1788625094.925861:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206087552:0@lo:400: 00000100:00100000:2.0:1788625094.926235:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206087680:12345-0@lo:400: Request processed in 966us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625094.926244:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788625094.927703:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206087424:0@lo:400: 00000100:00100000:0.0:1788625094.928802:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:3635:x1875509206087296:12345-0@lo:400: Request processed in 3069us (3629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625094.928822:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788625094.928921:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206087808 00000100:00100000:0.0:1788625094.928934:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206087808 00000100:00100000:0.0:1788625094.929002:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788625094.929013:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206087808:12345-0@lo:400: 00000100:00100000:0.0:1788625094.929096:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206087808:12345-0@lo:400: Request processed in 85us (3883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625094.929103:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788625094.929163:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206087296:0@lo:400: 00000100:00100000:0.0:1788625094.929195:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206087808:0@lo:400: 00000100:00100000:1.0:1788625094.929811:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625094.929865:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206088064:0@lo:400: 00000100:00100000:1.0:1788625094.929902:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788625094.929943:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998741dc3100 x1875509206087040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625094.929955:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788625094.929984:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206087040:0@lo:13: 00000100:00100000:1.0:1788625094.930017:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206088064 00000100:00100000:1.0:1788625094.930023:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206088064 00000100:00100000:1.0:1788625094.930139:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788625094.930147:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206088064:12345-0@lo:400: 00000100:00100000:1.0:1788625094.930204:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206088064:12345-0@lo:400: Request processed in 58us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625094.930211:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788625094.930230:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788625094.930260:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742c5f800 x1875509206088064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625094.930270:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206088064:0@lo:400: 00000100:00100000:0.0:1788625094.930679:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206087552 00000100:00100000:0.0:1788625094.930685:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206087552 00000100:00100000:0.0:1788625094.930726:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788625094.930734:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206087552:12345-0@lo:400: 00000100:00100000:0.0:1788625094.930782:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206087552:12345-0@lo:400: Request processed in 50us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625094.930789:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625094.930830:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625094.930873:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206087936:0@lo:400: 00000100:00100000:2.0:1788625094.930901:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625094.930949:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206087424 00000100:00100000:2.0:1788625094.930953:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206087424 00000100:00100000:1.0:1788625094.931362:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206087552:0@lo:400: 00000100:00100000:2.0:1788625094.931557:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206087936 00000100:00100000:2.0:1788625094.931563:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206087936 00000100:00100000:2.0:1788625094.931608:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788625094.931617:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206087424:12345-0@lo:400: 00000100:00100000:2.0:1788625094.931671:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206087424:12345-0@lo:400: Request processed in 55us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625094.931678:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788625094.931692:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788625094.931698:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206087936:12345-0@lo:400: 00000100:00080000:1.0:1788625094.931877:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625094.932079:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206087936:12345-0@lo:400: Request processed in 380us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625094.932550:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788625094.932614:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742c5ca80 x1875509206087424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625094.932629:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206087424:0@lo:400: 00010000:00080000:2.0:1788625094.932642:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742c5ce00 x1875509206087936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625094.932651:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206087936:0@lo:400: 00010000:00010000:1.0:1788625095.756839:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625095.949368:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625095.949399:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206088192:0@lo:41: 00000100:00100000:1.0:1788625095.949480:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625095.951333:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206088192 00000100:00100000:0.0:1788625095.951346:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206088192 00000100:00100000:0.0:1788625095.953117:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788625095.953133:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206088192:12345-0@lo:41: 00000004:00000024:0.0:1788625095.953179:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788625095.953270:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206088192:12345-0@lo:41: Request processed in 142us (3790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625095.953278:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788625095.954203:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206088192:0@lo:41: 00010000:00010000:3.0:1788625096.799982:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625097.803966:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625098.828225:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625099.533616:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625099.533644:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206088320:0@lo:41: 00000100:00100000:0.0:1788625099.533723:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625099.533791:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206088320 00000100:00100000:0.0:1788625099.533800:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206088320 00000100:00100000:0.0:1788625099.533848:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788625099.533858:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206088320:12345-0@lo:41: 00000004:00000024:0.0:1788625099.533893:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788625099.533938:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206088320:12345-0@lo:41: Request processed in 82us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625099.533946:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788625099.534005:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206088320:0@lo:41: 00010000:00010000:1.0:1788625099.853987:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625100.043743:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206088704:0@lo:400: 00000100:00100000:3.0:1788625100.043811:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206088576:0@lo:400: 00000100:00100000:1.0:1788625100.043815:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625100.043851:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625100.043875:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206089216:0@lo:400: 00000100:00100000:3.0:1788625100.043877:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206088448:0@lo:13: 00000100:00100000:3.0:1788625100.043898:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625100.043898:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625100.043915:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206089088:0@lo:400: 00000100:00100000:1.0:1788625100.043926:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206088960:0@lo:400: 00000100:00100000:3.0:1788625100.043937:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625100.043944:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625100.043960:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206089600:0@lo:400: 00000100:00100000:2.0:1788625100.044082:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206088576 00000100:00100000:2.0:1788625100.044089:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206088576 00000100:00100000:2.0:1788625100.044138:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788625100.044146:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:3637:x1875509206088576:12345-0@lo:400: 00000100:00100000:3.0:1788625100.045439:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625100.045583:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206089472:0@lo:400: 00000100:00100000:1.0:1788625100.045615:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625100.045638:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788625100.045645:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206088832:0@lo:400: 00000100:00100000:1.0:1788625100.045668:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625100.045688:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206089344:0@lo:400: 00000100:00100000:3.0:1788625100.045784:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625100.045870:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206089728:0@lo:13: 00000100:00100000:3.0:1788625100.045895:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625100.045941:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206088448 00000100:00100000:3.0:1788625100.045947:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206088448 00000100:00100000:3.0:1788625100.045985:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206089728 00000100:00100000:3.0:1788625100.045987:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206089728 00000100:00100000:3.0:1788625100.046002:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788625100.046022:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206088448:12345-0@lo:13: 00002000:00000024:3.0:1788625100.046051:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625100.046095:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206088448:12345-0@lo:13: Request processed in 74us (2195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625100.046102:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788625100.046123:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625100.046129:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206089728:12345-0@lo:13: 00002000:00000024:3.0:1788625100.046138:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625100.046161:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206089728:12345-0@lo:13: Request processed in 33us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625100.046167:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625100.046185:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206089088 00000100:00100000:3.0:1788625100.046189:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206089088 00000100:00100000:3.0:1788625100.046205:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206088832 00000100:00100000:3.0:1788625100.046207:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206088832 00000100:00100000:3.0:1788625100.046218:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788625100.046224:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206089088:12345-0@lo:400: 00000100:00100000:3.0:1788625100.046260:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206089088:12345-0@lo:400: Request processed in 36us (2322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625100.046266:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788625100.046278:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788625100.046283:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206088832:12345-0@lo:400: 00000100:00100000:3.0:1788625100.046311:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206088832:12345-0@lo:400: Request processed in 27us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625100.046316:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788625100.046334:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206089600 00000100:00100000:3.0:1788625100.046338:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206089600 00000100:00100000:3.0:1788625100.046370:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206089472 00000100:00100000:3.0:1788625100.046372:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206089472 00000100:00100000:3.0:1788625100.046387:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625100.046392:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206089600:12345-0@lo:400: 00000100:00100000:3.0:1788625100.046421:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206089600:12345-0@lo:400: Request processed in 29us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625100.046427:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625100.046438:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625100.046444:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206089472:12345-0@lo:400: 00000100:00100000:3.0:1788625100.046469:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206089472:12345-0@lo:400: Request processed in 25us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625100.046589:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788625100.046622:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742d26680 x1875509206089472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625100.046649:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206089472:0@lo:400: 00000100:00100000:1.0:1788625100.046672:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206088832:0@lo:400: 00000100:00100000:1.0:1788625100.046695:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206088704 00000100:00100000:1.0:1788625100.046699:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206088704 00000100:00100000:1.0:1788625100.047242:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206089216 00000100:00100000:1.0:1788625100.047247:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206089216 00000100:00100000:1.0:1788625100.047263:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206088960 00000100:00100000:1.0:1788625100.047266:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206088960 00000100:00100000:1.0:1788625100.047277:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206089344 00000100:00100000:1.0:1788625100.047279:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206089344 00000100:00100000:1.0:1788625100.047295:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788625100.047302:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206088704:12345-0@lo:400: 00000100:00100000:1.0:1788625100.047343:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206088704:12345-0@lo:400: Request processed in 42us (3528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625100.047349:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788625100.047362:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788625100.047368:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206089216:12345-0@lo:400: 00000100:00100000:1.0:1788625100.047395:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206089216:12345-0@lo:400: Request processed in 28us (3496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625100.047401:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788625100.047412:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788625100.047418:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206088960:12345-0@lo:400: 00000100:00100000:1.0:1788625100.047462:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206088960:12345-0@lo:400: Request processed in 45us (3516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625100.047468:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788625100.047492:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788625100.047829:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99885eec4380 x1875509206088960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625100.047841:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206088960:0@lo:400: 00000100:00100000:2.0:1788625100.050344:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:3637:x1875509206088576:12345-0@lo:400: Request processed in 6191us (6484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625100.050358:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788625100.050915:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788625100.050982:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998741dc1180 x1875509206089728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625100.051008:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206089728:0@lo:13: 00000100:00100000:3.0:1788625100.051020:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206088576:0@lo:400: 00010000:00080000:3.0:1788625100.051034:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742c5d180 x1875509206088448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625100.051045:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206088448:0@lo:13: 00000100:00100000:3.0:1788625100.051055:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206089088:0@lo:400: 00010000:00080000:3.0:1788625100.051064:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742d25c00 x1875509206089600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625100.051072:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206089600:0@lo:400: 00000100:00080000:3.0:1788625100.051159:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625100.051172:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625100.051175:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788625100.051214:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742d27480 x1875509206089216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625100.051224:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206089216:0@lo:400: 00010000:00080000:3.0:1788625100.051237:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99885eec5f80 x1875509206088704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625100.051244:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206088704:0@lo:400: 00000100:00100000:1.0:1788625100.051333:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206089344:12345-0@lo:400: 00000100:00100000:1.0:1788625100.051397:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206089344:12345-0@lo:400: Request processed in 71us (4808us total) trans 0 rc 0/0 00010000:00080000:0.0:1788625100.052078:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742d24380 x1875509206089344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625100.052090:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206089344:0@lo:400: 00000100:00100000:1.0:1788625100.055081:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788625100.881728:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625101.070341:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625101.070365:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206089856:0@lo:41: 00000100:00100000:0.0:1788625101.070439:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625101.070612:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206089856 00000100:00100000:1.0:1788625101.070621:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206089856 00000100:00100000:1.0:1788625101.070675:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788625101.070685:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206089856:12345-0@lo:41: 00000004:00000024:1.0:1788625101.070718:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788625101.070776:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206089856:12345-0@lo:41: Request processed in 92us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625101.070784:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788625101.070878:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206089856:0@lo:41: 00000020:01000004:2.0:1788625101.813339:0:9502:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788625101.813344:0:9502:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788625101.813346:0:9502:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788625101.816949:0:9502:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9988449c9000 00000020:01000004:2.0:1788625101.816975:0:9502:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788625101.816992:0:9502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788625101.817008:0:9502:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99887b48b380) 00000020:00000080:2.0:1788625101.817027:0:9502:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788625101.864116:0:9502:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788625101.864201:0:9502:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1788625101.887876:0:9502:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788625101.888108:0:9502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788625101.889263:0:9502:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788625101.889279:0:9502:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2d2e3b3f34a7a161 00000020:01000004:3.0:1788625101.889287:0:9502:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788625101.889310:0:9502:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.114@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788625101.889314:0:9502:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788625101.889321:0:9502:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788625101.889353:0:9502:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788625101.889358:0:9502:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:0.0:1788625101.900360:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788625101.911731:0:9502:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.114@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788625101.911833:0:9502:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.114@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788625101.911838:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788625101.911840:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788625101.911842:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625101.911843:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625101.911845:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625101.911847:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625101.911849:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625101.911850:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788625101.911852:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788625101.911854:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625101.911855:0:9502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788625101.911859:0:9502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788625101.911867:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788625101.911869:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788625101.911870:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625101.911871:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625101.911872:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625101.911874:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625101.911875:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625101.911876:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788625101.911877:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788625101.911878:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625101.911880:0:9502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788625101.911908:0:9502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788625101.911927:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206089984:0@lo:253: 00000100:00100000:2.0:1788625101.912008:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625101.912063:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fea300 going to sleep for 11 seconds 00000100:00100000:0.0:1788625101.912427:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206089984 00000100:00100000:0.0:1788625101.912450:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206089984 00000100:00100000:0.0:1788625101.912537:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788625101.912549:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:9502:x1875509206089984:12345-0@lo:253: 20000000:01000000:0.0:1788625101.912579:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788625101.912584:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788625101.912589:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788625101.912592:0:6506:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788625101.912834:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788625101.912951:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1788625101.912966:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788625101.912983:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1788625101.912989:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788625101.913002:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1788625101.913017:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1788625101.913099:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1788625101.913114:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.114@tcp 20000000:01000000:0.0:1788625101.913122:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.114@tcp (null) (null) (null) 00000040:00080000:0.0:1788625101.913141:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1788625101.913148:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788625101.913163:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1788625101.913168:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.114@tcp (null) (null) 00000040:00080000:0.0:1788625101.913180:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1788625101.913186:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788625101.913198:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1788625101.913213:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1788625101.913286:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1788625101.913297:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.114@tcp 20000000:01000000:0.0:1788625101.913299:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.114@tcp (null) (null) (null) 00000040:00080000:0.0:1788625101.913313:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1788625101.913318:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788625101.913332:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1788625101.913337:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.114@tcp (null) (null) 00000040:00080000:0.0:1788625101.913349:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1788625101.913354:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788625101.913367:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1788625101.913383:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1788625101.913776:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1788625101.913789:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.114@tcp 20000000:01000000:0.0:1788625101.913790:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.114@tcp (null) (null) (null) 00000040:00080000:0.0:1788625101.913805:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1788625101.913810:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788625101.913824:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1788625101.913828:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.114@tcp (null) (null) 00000040:00080000:0.0:1788625101.913857:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1788625101.913864:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788625101.913878:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1788625101.913903:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1788625101.913916:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788625101.913918:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788625101.913922:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788625101.913962:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788625101.913964:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788625101.916132:0:9508:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1788625101.916197:0:9508:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1788625101.916214:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788625101.916618:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788625101.916642:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788625101.916657:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788625101.916672:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788625101.916675:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788625101.918273:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788625101.918310:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788625101.918328:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1788625101.918711:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1788625101.918734:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1788625101.918748:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1788625101.918759:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788625101.918761:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788625101.922291:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1788625101.922636:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1788625101.922672:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1788625101.922693:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1788625101.922708:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788625101.922711:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788625101.923656:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1788625101.923684:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1788625101.923703:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1788625101.923885:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1788625101.923908:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1788625101.923923:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1788625101.923937:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788625101.923940:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788625101.924426:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788625101.924462:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788625101.924477:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1788625101.924659:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1788625101.924679:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1788625101.924692:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:2.0:1788625101.924707:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788625101.924728:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99887cac6800/0x2d2e3b3f34a7a168 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.924747:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a05e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a057 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.924764:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887c994200/0x2d2e3b3f34a7a088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a081 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.924770:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887c995400/0x2d2e3b3f34a7a0c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a0c0 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.924861:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887cac6200/0x2d2e3b3f34a7a0e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a0dc expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.924870:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887c995e00/0x2d2e3b3f34a7a10d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a0ff expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.924876:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a122 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.924881:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887c995800/0x2d2e3b3f34a7a153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a14c expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.924888:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99887cac6800/0x2d2e3b3f34a7a168 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.924931:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887c995800/0x2d2e3b3f34a7a153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a14c expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.924946:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887c995800/0x2d2e3b3f34a7a153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a14c expref: 21 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625101.924960:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206090112:0@lo:104: 00000100:00100000:2.0:1788625101.925025:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625101.925086:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a122 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.925095:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a122 expref: 21 pid: 6505 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625101.925104:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206090240:0@lo:104: 00000100:00100000:2.0:1788625101.925126:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625101.925207:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887c995e00/0x2d2e3b3f34a7a10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0ff expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.925216:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887c995e00/0x2d2e3b3f34a7a10d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0ff expref: 21 pid: 6505 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625101.925223:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206090368:0@lo:104: 00000100:00100000:2.0:1788625101.925315:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625101.925349:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887cac6200/0x2d2e3b3f34a7a0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0dc expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.925357:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887cac6200/0x2d2e3b3f34a7a0e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0dc expref: 21 pid: 6506 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625101.925394:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206090112 00000100:00100000:0.0:1788625101.925403:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206090112 00000100:00100000:2.0:1788625101.925431:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206090496:0@lo:104: 00000100:00100000:0.0:1788625101.925447:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206090240 00000100:00100000:0.0:1788625101.925451:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206090240 00000100:00100000:0.0:1788625101.925464:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206090368 00000100:00100000:0.0:1788625101.925468:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206090368 00000100:00100000:2.0:1788625101.925469:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625101.925482:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206090496 00000100:00100000:0.0:1788625101.925485:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206090496 00010000:00010000:2.0:1788625101.925496:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887c995400/0x2d2e3b3f34a7a0c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0c0 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625101.925503:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1788625101.925511:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887c995400/0x2d2e3b3f34a7a0c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0c0 expref: 21 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625101.925545:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206090624:0@lo:104: 00000100:00100000:0.0:1788625101.925549:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:6506:x1875509206090112:12345-0@lo:104: 00010000:00010000:0.0:1788625101.925563:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887cac7600/0x2d2e3b3f34a7a14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a153 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.925614:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788625101.925621:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:6506:x1875509206090112:12345-0@lo:104: Request processed in 108us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625101.925630:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625101.925647:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788625101.925652:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625101.925657:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:6506:x1875509206090240:12345-0@lo:104: 00010000:00010000:0.0:1788625101.925665:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887b682200/0x2d2e3b3f34a7a122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a129 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.925677:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887c994200/0x2d2e3b3f34a7a088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a081 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.925688:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887c994200/0x2d2e3b3f34a7a088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a081 expref: 21 pid: 6505 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625101.925699:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206090752:0@lo:104: 00010000:00010000:0.0:1788625101.925699:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788625101.925707:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:6506:x1875509206090240:12345-0@lo:104: Request processed in 52us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625101.925724:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788625101.925737:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206090624 00000100:00100000:2.0:1788625101.925741:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625101.925742:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206090624 00000100:00100000:0.0:1788625101.925764:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788625101.925774:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206090752 00000100:00100000:0.0:1788625101.925776:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206090752 00010000:00010000:2.0:1788625101.925779:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a05e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a057 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.925789:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a05e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a057 expref: 21 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625101.925794:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788625101.925803:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:6506:x1875509206090368:12345-0@lo:104: 00000100:00100000:2.0:1788625101.925810:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206090880:0@lo:104: 00010000:00010000:0.0:1788625101.925814:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887c994600/0x2d2e3b3f34a7a0ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a10d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625101.925839:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625101.925855:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788625101.925856:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988583626c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625101.925863:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:6506:x1875509206090368:12345-0@lo:104: Request processed in 59us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625101.925870:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788625101.925880:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206090880 00000100:00100000:2.0:1788625101.925882:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206090112:0@lo:104: 00000100:00100000:0.0:1788625101.925884:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206090880 00000100:00100000:2.0:1788625101.925899:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206090240:0@lo:104: 00000100:00100000:0.0:1788625101.925903:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788625101.925912:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:6506:x1875509206090496:12345-0@lo:104: 00000100:00100000:2.0:1788625101.925915:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206090368:0@lo:104: 00010000:00010000:0.0:1788625101.925921:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998882170e00/0x2d2e3b3f34a7a0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a0e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.925970:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788625101.925976:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:6506:x1875509206090496:12345-0@lo:104: Request processed in 65us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625101.925984:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788625101.925991:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206090496:0@lo:104: 00000100:00100000:0.0:1788625101.926000:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788625101.926007:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:6506:x1875509206090624:12345-0@lo:104: 00010000:00010000:0.0:1788625101.926019:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998882171a00/0x2d2e3b3f34a7a0c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a0c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926054:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788625101.926059:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:6506:x1875509206090624:12345-0@lo:104: Request processed in 53us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625101.926064:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788625101.926075:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788625101.926080:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987425ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:6506:x1875509206090752:12345-0@lo:104: 00010000:00010000:0.0:1788625101.926086:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887cac7200/0x2d2e3b3f34a7a081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a088 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625101.926104:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206090624:0@lo:104: 00010000:00010000:0.0:1788625101.926113:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788625101.926120:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206090752:0@lo:104: 00000100:00100000:0.0:1788625101.926121:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987425ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:6506:x1875509206090752:12345-0@lo:104: Request processed in 39us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625101.926132:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788625101.926160:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788625101.926166:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:6506:x1875509206090880:12345-0@lo:104: 00010000:00010000:0.0:1788625101.926173:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998882170800/0x2d2e3b3f34a7a057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a05e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926196:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788625101.926200:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:6506:x1875509206090880:12345-0@lo:104: Request processed in 35us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625101.926205:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788625101.926220:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788625101.926226:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887cac7600/0x2d2e3b3f34a7a14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a153 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926238:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7600 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625101.926243:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887cac7600/0x2d2e3b3f34a7a14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a153 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926252:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887cac7600/0x2d2e3b3f34a7a14c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a153 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625101.926259:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887cac7600/0x2d2e3b3f34a7a14c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a153 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625101.926265:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625101.926291:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887cac7600/0x2d2e3b3f34a7a14c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a153 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926295:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788625101.926308:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875509206090880:0@lo:104: 00010000:00010000:0.0:1788625101.926315:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887cac7600/0x2d2e3b3f34a7a14c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a153 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926323:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887cac7600/0x2d2e3b3f34a7a14c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a153 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926337:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788625101.926340:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b682200/0x2d2e3b3f34a7a122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a129 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.926341:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99887cac6800/0x2d2e3b3f34a7a168 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926354:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682200 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625101.926357:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b682200/0x2d2e3b3f34a7a122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a129 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926378:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b682200/0x2d2e3b3f34a7a122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a129 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625101.926384:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b682200/0x2d2e3b3f34a7a122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a129 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625101.926388:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625101.926401:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b682200/0x2d2e3b3f34a7a122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a129 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926422:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625101.926434:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b682200/0x2d2e3b3f34a7a122 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a129 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926453:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b682200/0x2d2e3b3f34a7a122 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a129 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926464:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788625101.926467:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887c994600/0x2d2e3b3f34a7a0ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a10d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926473:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994600 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625101.926476:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887c994600/0x2d2e3b3f34a7a0ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a10d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926483:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887c994600/0x2d2e3b3f34a7a0ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a10d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625101.926490:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887c994600/0x2d2e3b3f34a7a0ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a10d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625101.926500:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625101.926513:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887c994600/0x2d2e3b3f34a7a0ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a10d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926539:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625101.926546:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887c994600/0x2d2e3b3f34a7a0ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a10d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926553:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887c994600/0x2d2e3b3f34a7a0ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a10d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926561:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788625101.926564:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998882170e00/0x2d2e3b3f34a7a0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a0e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926569:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625101.926572:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998882170e00/0x2d2e3b3f34a7a0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a0e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926579:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998882170e00/0x2d2e3b3f34a7a0dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a0e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625101.926586:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998882170e00/0x2d2e3b3f34a7a0dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a0e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625101.926591:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625101.926600:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998882170e00/0x2d2e3b3f34a7a0dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a0e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926606:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625101.926616:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998882170e00/0x2d2e3b3f34a7a0dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a0e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926623:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998882170e00/0x2d2e3b3f34a7a0dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a0e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926632:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788625101.926635:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998882171a00/0x2d2e3b3f34a7a0c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a0c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926641:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171a00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625101.926644:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998882171a00/0x2d2e3b3f34a7a0c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a0c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926650:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998882171a00/0x2d2e3b3f34a7a0c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a0c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625101.926656:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998882171a00/0x2d2e3b3f34a7a0c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a0c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625101.926662:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625101.926670:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998882171a00/0x2d2e3b3f34a7a0c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a0c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926674:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625101.926677:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998882171a00/0x2d2e3b3f34a7a0c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a0c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926683:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998882171a00/0x2d2e3b3f34a7a0c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a0c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926691:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788625101.926698:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887cac7200/0x2d2e3b3f34a7a081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a088 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926704:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7200 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625101.926708:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887cac7200/0x2d2e3b3f34a7a081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a088 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926715:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887cac7200/0x2d2e3b3f34a7a081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a088 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625101.926721:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887cac7200/0x2d2e3b3f34a7a081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a088 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625101.926726:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625101.926737:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887cac7200/0x2d2e3b3f34a7a081 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a088 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926742:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625101.926746:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887cac7200/0x2d2e3b3f34a7a081 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a088 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926753:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887cac7200/0x2d2e3b3f34a7a081 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a088 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926760:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625101.926763:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998882170800/0x2d2e3b3f34a7a057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a05e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926769:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625101.926771:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998882170800/0x2d2e3b3f34a7a057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a05e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926786:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998882170800/0x2d2e3b3f34a7a057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a05e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625101.926792:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998882170800/0x2d2e3b3f34a7a057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a05e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625101.926797:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625101.926809:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998882170800/0x2d2e3b3f34a7a057 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a05e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926814:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625101.926818:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998882170800/0x2d2e3b3f34a7a057 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a05e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926825:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998882170800/0x2d2e3b3f34a7a057 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a05e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.926836:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625101.926838:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625101.926839:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625101.926859:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206091008:0@lo:103: 00000100:00100000:0.0:1788625101.926893:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625101.926920:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206091520:0@lo:103: 00000100:00100000:0.0:1788625101.926937:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625101.926955:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625101.926960:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206091392:0@lo:103: 00000100:00100000:0.0:1788625101.926977:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625101.927038:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206091136:0@lo:103: 00000100:00100000:2.0:1788625101.927046:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206091008 00000100:00100000:2.0:1788625101.927053:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206091008 00010000:00010000:2.0:1788625101.927084:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887c995800/0x2d2e3b3f34a7a153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a14c expref: 22 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625101.927103:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206091520 00000100:00100000:2.0:1788625101.927107:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206091520 00010000:00010000:2.0:1788625101.927119:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887c995400/0x2d2e3b3f34a7a0c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0c0 expref: 23 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625101.927131:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206091392 00000100:00100000:2.0:1788625101.927133:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206091392 00010000:00010000:2.0:1788625101.927315:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887cac6200/0x2d2e3b3f34a7a0e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0dc expref: 24 pid: 6506 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625101.927331:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788625101.927339:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206091008:12345-0@lo:103: 00010000:00010000:2.0:1788625101.927351:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625101.927357:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887c995800/0x2d2e3b3f34a7a153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a14c expref: 24 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.927447:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887c995800/0x2d2e3b3f34a7a153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a14c expref: 24 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.927463:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c995800/0x2d2e3b3f34a7a153 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a14c expref: 24 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.927475:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625101.927574:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625101.928348:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625101.928386:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206091648:0@lo:103: 00000100:00100000:3.0:1788625101.928414:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625101.928430:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788625101.928451:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206091264:0@lo:103: 00000100:00100000:3.0:1788625101.928473:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625101.928483:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206091776:0@lo:103: 00000100:00100000:3.0:1788625101.928499:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625101.929193:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788625101.929215:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788625101.929433:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206091136 00000100:00100000:0.0:1788625101.929450:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206091136 00010000:00010000:0.0:1788625101.929483:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a122 expref: 24 pid: 6505 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625101.929506:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788625101.929511:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206091648 00000100:00100000:1.0:1788625101.929571:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788625101.929580:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206091264 00000100:00100000:1.0:1788625101.929584:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206091264 00010000:00010000:1.0:1788625101.929602:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887c995e00/0x2d2e3b3f34a7a10d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0ff expref: 25 pid: 6505 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625101.929629:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788625101.929633:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206091776 00000100:00100000:1.0:1788625101.929636:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206091776 00010000:00010000:1.0:1788625101.929646:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a05e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a057 expref: 26 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625101.929656:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788625101.929662:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788625101.929669:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+26:3636:x1875509206091520:12345-0@lo:103: 00010000:00010000:1.0:1788625101.929695:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625101.929701:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887c995400/0x2d2e3b3f34a7a0c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0c0 expref: 26 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.929711:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887c995400/0x2d2e3b3f34a7a0c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0c0 expref: 26 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.929726:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c995400/0x2d2e3b3f34a7a0c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0c0 expref: 26 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.929739:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625101.929793:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+25:3636:x1875509206091520:12345-0@lo:103: Request processed in 124us (2854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625101.929801:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788625101.929815:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788625101.929822:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788625101.929828:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206091392:12345-0@lo:103: 00010000:00010000:1.0:1788625101.929836:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625101.929841:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887cac6200/0x2d2e3b3f34a7a0e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0dc expref: 24 pid: 6506 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.929855:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887cac6200/0x2d2e3b3f34a7a0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0dc expref: 24 pid: 6506 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.929866:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac6200/0x2d2e3b3f34a7a0e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0dc expref: 24 pid: 6506 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.929875:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625101.929898:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:3636:x1875509206091392:12345-0@lo:103: Request processed in 71us (2920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625101.929904:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788625101.929915:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788625101.929921:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788625101.929927:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:3637:x1875509206091136:12345-0@lo:103: 00010000:00010000:1.0:1788625101.929933:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625101.929938:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a122 expref: 22 pid: 6505 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.929948:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a122 expref: 22 pid: 6505 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.929957:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a122 expref: 22 pid: 6505 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.929965:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625101.929992:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:3637:x1875509206091136:12345-0@lo:103: Request processed in 66us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625101.929998:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788625101.930008:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788625101.930020:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788625101.930026:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:3637:x1875509206091264:12345-0@lo:103: 00010000:00010000:1.0:1788625101.930033:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625101.930038:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887c995e00/0x2d2e3b3f34a7a10d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0ff expref: 20 pid: 6505 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.930047:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887c995e00/0x2d2e3b3f34a7a10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0ff expref: 20 pid: 6505 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.930057:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c995e00/0x2d2e3b3f34a7a10d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0ff expref: 20 pid: 6505 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.930065:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625101.930087:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:3637:x1875509206091264:12345-0@lo:103: Request processed in 62us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625101.930093:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788625101.930104:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788625101.930109:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625101.930114:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:3637:x1875509206091776:12345-0@lo:103: 00010000:00010000:1.0:1788625101.930121:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625101.930125:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a05e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a057 expref: 18 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.930133:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a05e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a057 expref: 18 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.930141:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a05e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a057 expref: 18 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.930148:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625101.930175:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:3637:x1875509206091776:12345-0@lo:103: Request processed in 61us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625101.930181:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625101.930218:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206091264:0@lo:103: 00000100:00100000:1.0:1788625101.930229:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206091776:0@lo:103: 00000100:00100000:1.0:1788625101.930236:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206091136:0@lo:103: 00000100:00100000:0.0:1788625101.931194:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206091648 00010000:00010000:0.0:1788625101.931227:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887c994200/0x2d2e3b3f34a7a088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a081 expref: 17 pid: 6505 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625101.931262:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788625101.931272:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788625101.931279:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:3637:x1875509206091648:12345-0@lo:103: 00010000:00010000:0.0:1788625101.931289:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625101.931293:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887c994200/0x2d2e3b3f34a7a088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a081 expref: 17 pid: 6505 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.931304:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887c994200/0x2d2e3b3f34a7a088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a081 expref: 17 pid: 6505 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.931317:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c994200/0x2d2e3b3f34a7a088 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a081 expref: 17 pid: 6505 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.931331:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99887cac6800/0x2d2e3b3f34a7a168 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.931339:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac6800/0x2d2e3b3f34a7a168 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.931353:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887cac6800/0x2d2e3b3f34a7a168 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.931370:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887cac6800/0x2d2e3b3f34a7a168 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.931377:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99887cac6800/0x2d2e3b3f34a7a168 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.931383:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99887cac6800/0x2d2e3b3f34a7a168 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.931390:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625101.931395:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99887cac6800/0x2d2e3b3f34a7a168 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.931403:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99887cac6800/0x2d2e3b3f34a7a168 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.931424:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99887cac6800/0x2d2e3b3f34a7a168 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.931445:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625101.931503:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:3637:x1875509206091648:12345-0@lo:103: Request processed in 224us (3088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625101.931510:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788625101.931565:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206091648:0@lo:103: 00000100:00100000:0.0:1788625101.931591:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206091392:0@lo:103: 00000100:00100000:0.0:1788625101.931601:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206091520:0@lo:103: 00010000:00010000:0.0:1788625101.931618:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99887cac6800/0x2d2e3b3f34a7a168 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.931636:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99887cac6800/0x2d2e3b3f34a7a168 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.931643:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac6800/0x2d2e3b3f34a7a168 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788625101.931656:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788625101.933494:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:3636:x1875509206091008:12345-0@lo:103: Request processed in 6147us (6591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625101.933531:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625101.933610:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206091008:0@lo:103: 00000100:00100000:0.0:1788625101.936086:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:9502:x1875509206089984:12345-0@lo:253: Request processed in 23531us (24072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625101.936101:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788625101.943639:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206089984:0@lo:253: 10000000:01000000:2.0:1788625101.943662:0:9502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788625101.943665:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788625101.943667:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788625101.943669:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625101.943670:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788625101.943672:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625101.943673:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625101.943674:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625101.943676:0:9502:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788625101.943678:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625101.943679:0:9502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788625101.943704:0:9502:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9988449c9000 from lustre-OST0001 10000000:01000000:2.0:1788625101.943734:0:9502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788625101.943736:0:9502:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788625101.943746:0:9502:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99885ecd99c0 local copy 10000000:01000000:2.0:1788625101.943750:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788625101.943786:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a16f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.943798:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a16f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.943808:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a16f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625101.943827:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206091904:0@lo:101: 00000100:00100000:2.0:1788625101.943893:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625101.943943:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433bf600 going to sleep for 11 seconds 00000100:00100000:3.0:1788625101.944036:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206091904 00000100:00100000:3.0:1788625101.944043:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206091904 00000100:00100000:3.0:1788625101.944094:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788625101.944103:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+14:9502:x1875509206091904:12345-0@lo:101: 00010000:00010000:3.0:1788625101.944115:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625101.944127:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b683600/0x2d2e3b3f34a7a176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a16f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625101.944152:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b683600/0x2d2e3b3f34a7a176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a16f expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625101.944162:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b683600/0x2d2e3b3f34a7a176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a16f expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625101.944171:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683600, rc 0) 00000100:00100000:3.0:1788625101.944215:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:9502:x1875509206091904:12345-0@lo:101: Request processed in 113us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625101.944222:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788625101.944294:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206091904:0@lo:101: 00010000:00010000:2.0:1788625101.944323:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a16f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2d2e3b3f34a7a176 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.944332:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a16f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2d2e3b3f34a7a176 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625101.944414:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206092032:0@lo:501: 00000100:00100000:2.0:1788625101.944450:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625101.944479:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433bf600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625101.944542:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206092032 00000100:00100000:1.0:1788625101.944547:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206092032 00000100:00100000:1.0:1788625101.944574:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788625101.944581:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:9502:x1875509206092032:12345-0@lo:501: 00000100:00100000:1.0:1788625101.944641:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:9502:x1875509206092032:12345-0@lo:501: Request processed in 60us (190us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788625101.944648:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788625101.945026:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206092032:0@lo:501: 10000000:01000000:2.0:1788625101.945038:0:9502:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788625101.945056:0:9502:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788625101.945061:0:9502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a16f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2d2e3b3f34a7a176 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.945070:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a16f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2d2e3b3f34a7a176 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.945077:0:9502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2d2e3b3f34a7a176 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.945102:0:9502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788625101.945125:0:9502:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9988449c9000 10000000:01000000:2.0:1788625101.945131:0:9502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788625101.945135:0:9502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788625101.945138:0:9502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788625101.945142:0:9502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788625101.945144:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788625101.945167:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a17d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.945174:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a17d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625101.945181:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a17d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625101.945193:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206092160:0@lo:101: 00000100:00100000:2.0:1788625101.945219:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625101.945247:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff998850dbd900 going to sleep for 11 seconds 00000100:00100000:3.0:1788625101.945291:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206092160 00000100:00100000:3.0:1788625101.945296:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206092160 00000100:00100000:3.0:1788625101.945337:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788625101.945344:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:9502:x1875509206092160:12345-0@lo:101: 00010000:00010000:3.0:1788625101.945353:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625101.945362:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b683c00/0x2d2e3b3f34a7a184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a17d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625101.945379:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b683c00/0x2d2e3b3f34a7a184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a17d expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625101.945388:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b683c00/0x2d2e3b3f34a7a184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a17d expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625101.945395:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683c00, rc 0) 00000100:00100000:3.0:1788625101.945427:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9502:x1875509206092160:12345-0@lo:101: Request processed in 84us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625101.945433:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788625101.945495:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206092160:0@lo:101: 00010000:00010000:3.0:1788625101.945598:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a17d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a184 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625101.945607:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a17d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a184 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625101.945669:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206092288:0@lo:501: 00000100:00100000:3.0:1788625101.945694:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625101.945709:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b715d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625101.945722:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206092288 00000100:00100000:3.0:1788625101.945726:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206092288 00000100:00100000:3.0:1788625101.945747:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788625101.945761:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9502:x1875509206092288:12345-0@lo:501: 00010000:00010000:1.0:1788625101.945911:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625101.945917:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2d2e3b3f34a7a176 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.945925:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625101.945929:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2d2e3b3f34a7a176 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.945937:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2d2e3b3f34a7a176 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625101.945944:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2d2e3b3f34a7a176 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625101.945950:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625101.945975:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a16f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2d2e3b3f34a7a176 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.945981:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625101.946004:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a16f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2d2e3b3f34a7a176 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625101.946247:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206092416:0@lo:103: 00000100:00100000:0.0:1788625101.946278:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625101.946313:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206092416 00000100:00100000:0.0:1788625101.946317:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206092416 00000100:00100000:0.0:1788625101.946347:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625101.946353:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:3635:x1875509206092416:12345-0@lo:103: 00010000:00010000:0.0:1788625101.946362:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625101.946372:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b683600/0x2d2e3b3f34a7a176 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a16f expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.946385:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625101.946410:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:3635:x1875509206092416:12345-0@lo:103: Request processed in 58us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625101.946416:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625101.946452:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206092416:0@lo:103: 00010000:00010000:1.0:1788625101.946596:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a16f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2d2e3b3f34a7a176 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.946610:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625101.946611:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625101.946613:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625101.946945:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:9502:x1875509206092288:12345-0@lo:501: Request processed in 1182us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625101.946952:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788625101.953392:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206092288:0@lo:501: 00000100:00100000:2.0:1788625101.953483:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206092544:0@lo:503: 00000100:00100000:2.0:1788625101.953784:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625101.953838:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff998850dbd900 going to sleep for 11 seconds 00000100:00100000:3.0:1788625101.953898:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206092544 00000100:00100000:3.0:1788625101.953905:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206092544 00000100:00100000:3.0:1788625101.953963:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788625101.953974:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:9502:x1875509206092544:12345-0@lo:503: 00000100:00100000:3.0:1788625101.954093:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:9502:x1875509206092544:12345-0@lo:503: Request processed in 121us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625101.954102:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788625101.954207:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206092544:0@lo:503: 00000040:00080000:2.0:1788625101.954503:0:9502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788625101.954743:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206092672:0@lo:502: 00000100:00100000:2.0:1788625101.954789:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625101.954813:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff998858362000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625101.954900:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206092672 00000100:00100000:3.0:1788625101.954905:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206092672 00000100:00100000:3.0:1788625101.954941:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788625101.954949:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:9502:x1875509206092672:12345-0@lo:502: 00000100:00100000:3.0:1788625101.955041:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:9502:x1875509206092672:12345-0@lo:502: Request processed in 92us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625101.955047:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788625101.955123:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206092672:0@lo:502: 00000040:00080000:0.0:1788625101.955351:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788625101.955377:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788625101.955391:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788625101.955403:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788625101.955423:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788625101.955451:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788625101.955475:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206092800:0@lo:502: 00000100:00100000:0.0:1788625101.955513:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625101.955569:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c4db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625101.955948:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206092800 00000100:00100000:1.0:1788625101.955954:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206092800 00000100:00100000:1.0:1788625101.955984:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788625101.955991:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:9502:x1875509206092800:12345-0@lo:502: 00000100:00100000:1.0:1788625101.956095:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:9502:x1875509206092800:12345-0@lo:502: Request processed in 103us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625101.956102:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788625101.957570:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206092800:0@lo:502: 00000040:00080000:0.0:1788625101.957653:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788625101.957670:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1788625101.958504:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788625101.958512:0:9514:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788625101.958616:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625101.958619:0:9514:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788625101.958626:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788625101.958650:0:9514:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff998742ed0000) 00000020:00000080:3.0:1788625101.958676:0:9514:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788625101.958684:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788625101.958775:0:9514:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9988449c9000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788625101.958783:0:9514:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788625101.958795:0:9514:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2d2e3b3f34a7a192 00010000:00010000:3.0:1788625101.965754:0:9514:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788625101.966140:0:9514:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788625101.969750:0:9514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788625101.970093:0:9514:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788625101.975195:0:9514:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788625101.975390:0:9514:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788625101.985297:0:9514:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788625101.987483:0:9514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788625101.987506:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625101.987538:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625101.987541:0:9514:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788625101.987546:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625101.987551:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625101.987552:0:9514:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788625101.987555:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788625101.987557:0:9514:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788625101.987575:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625101.987578:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625101.987579:0:9514:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788625101.987582:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788625101.987939:0:9502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788625101.987966:0:9502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788625101.987987:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a17d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a184 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.988000:0:9502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a184 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625101.988014:0:9502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9988449c9000 from 1 10000000:01000000:1.0:1788625101.988017:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625101.988061:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7a199 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.988070:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7a199 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625101.988081:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7a199 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625101.988100:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206092928:0@lo:101: 00000100:00100000:1.0:1788625101.988168:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625101.988210:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c8c7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788625101.988327:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206092928 00000100:00100000:3.0:1788625101.988336:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206092928 00000100:00100000:3.0:1788625101.988396:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788625101.988407:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:9502:x1875509206092928:12345-0@lo:101: 00010000:00010000:3.0:1788625101.988419:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625101.988432:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a1a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a199 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625101.988474:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a1a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a199 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625101.988484:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a1a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a199 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625101.988493:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683200, rc 0) 00000100:00100000:3.0:1788625101.988559:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9502:x1875509206092928:12345-0@lo:101: Request processed in 153us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625101.988566:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788625101.988606:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206092928:0@lo:101: 00010000:00010000:3.0:1788625101.988618:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7a199 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a1a0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625101.988638:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7a199 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a1a0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625101.988716:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093056:0@lo:501: 00000100:00100000:3.0:1788625101.988738:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625101.988757:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b715480 going to sleep for 11 seconds 00000100:00100000:3.0:1788625101.988770:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206093056 00000100:00100000:3.0:1788625101.988773:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206093056 00000100:00100000:3.0:1788625101.988803:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788625101.988808:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9502:x1875509206093056:12345-0@lo:501: 00000100:00100000:3.0:1788625101.988884:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9502:x1875509206093056:12345-0@lo:501: Request processed in 76us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625101.988891:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788625101.988915:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093056:0@lo:501: 00000100:00100000:3.0:1788625101.988936:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093184:0@lo:503: 00000100:00100000:3.0:1788625101.988969:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625101.988980:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b715480 going to sleep for 11 seconds 00000100:00100000:3.0:1788625101.988990:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206093184 00000100:00100000:3.0:1788625101.988993:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206093184 00000100:00100000:1.0:1788625101.989464:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788625101.989475:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9502:x1875509206093184:12345-0@lo:503: 00000100:00100000:1.0:1788625101.989585:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9502:x1875509206093184:12345-0@lo:503: Request processed in 113us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625101.989592:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788625101.989774:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093184:0@lo:503: 00000040:00080000:3.0:1788625101.989987:0:9502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788625101.990457:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093312:0@lo:502: 00000100:00100000:3.0:1788625101.990830:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625101.990862:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b7a1540 going to sleep for 11 seconds 00000100:00100000:1.0:1788625101.990913:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206093312 00000100:00100000:1.0:1788625101.990919:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206093312 00000100:00100000:1.0:1788625101.990992:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788625101.991000:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9502:x1875509206093312:12345-0@lo:502: 00000100:00100000:1.0:1788625101.991112:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9502:x1875509206093312:12345-0@lo:502: Request processed in 112us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625101.991119:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788625101.992949:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093312:0@lo:502: 00000040:00080000:0.0:1788625101.993171:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788625101.993198:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788625101.993231:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093440:0@lo:502: 00000100:00100000:0.0:1788625101.993287:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625101.997734:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c4d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788625101.997743:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206093440 00000100:00100000:3.0:1788625101.997759:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206093440 00000100:00100000:3.0:1788625101.997803:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788625101.997812:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9502:x1875509206093440:12345-0@lo:502: 00000100:00100000:3.0:1788625101.997945:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9502:x1875509206093440:12345-0@lo:502: Request processed in 133us (4657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625101.997952:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788625101.998101:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093440:0@lo:502: 00000040:00080000:0.0:1788625101.998304:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788625101.998319:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788625101.999107:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625101.999117:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625101.999120:0:9518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788625101.999126:0:9518:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9988449c9000 00000020:00000080:3.0:1788625101.999129:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625101.999139:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625101.999141:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625101.999143:0:9518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788625101.999145:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788625101.999249:0:9502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788625101.999271:0:9502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788625101.999323:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7a199 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a1a0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.999334:0:9502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7a199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a1a0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625101.999398:0:9502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788625101.999401:0:9502:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9988449c9000 10000000:01000000:0.0:1788625101.999404:0:9502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9988449c9000 10000000:01000000:0.0:1788625101.999409:0:9502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788625101.999415:0:9502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9988449c9000 from 1 10000000:01000000:0.0:1788625101.999418:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788625101.999462:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a7a1a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.999471:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a7a1a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625101.999481:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a7a1a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625101.999631:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093568:0@lo:101: 00000100:00100000:0.0:1788625101.999694:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625101.999722:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c4da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625101.999824:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206093568 00000100:00100000:3.0:1788625101.999830:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206093568 00000100:00100000:3.0:1788625101.999858:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788625101.999865:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9502:x1875509206093568:12345-0@lo:101: 00010000:00010000:3.0:1788625101.999876:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625101.999888:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7a1ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a1a7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625101.999909:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7a1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a1a7 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625101.999919:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7a1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a1a7 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625101.999928:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682a00, rc 0) 00000100:00100000:3.0:1788625101.999974:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:9502:x1875509206093568:12345-0@lo:101: Request processed in 108us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625101.999981:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788625102.000623:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093568:0@lo:101: 00010000:00010000:0.0:1788625102.000641:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a7a1a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a1ae expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625102.000651:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a7a1a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a1ae expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625102.000729:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093696:0@lo:501: 00000100:00100000:0.0:1788625102.001151:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625102.001187:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c4da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625102.001232:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206093696 00000100:00100000:1.0:1788625102.001237:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206093696 00000100:00100000:1.0:1788625102.001277:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788625102.001286:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:9502:x1875509206093696:12345-0@lo:501: 00000100:00100000:1.0:1788625102.001796:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:9502:x1875509206093696:12345-0@lo:501: Request processed in 510us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625102.001805:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788625102.001841:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093696:0@lo:501: 00000100:00100000:0.0:1788625102.001875:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093824:0@lo:503: 00000100:00100000:0.0:1788625102.001916:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625102.001945:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c4da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625102.001992:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206093824 00000100:00100000:1.0:1788625102.001996:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206093824 00000100:00100000:1.0:1788625102.002055:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788625102.002063:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:9502:x1875509206093824:12345-0@lo:503: 00000100:00100000:1.0:1788625102.002149:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:9502:x1875509206093824:12345-0@lo:503: Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625102.002155:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788625102.002219:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093824:0@lo:503: 00000040:00080000:0.0:1788625102.002468:0:9502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788625102.002715:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093952:0@lo:502: 00000100:00100000:0.0:1788625102.002763:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625102.002874:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c4da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625102.002980:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206093952 00000100:00100000:3.0:1788625102.002985:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206093952 00000100:00100000:2.0:1788625102.003127:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788625102.003134:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:9502:x1875509206093952:12345-0@lo:502: 00000100:00100000:2.0:1788625102.003222:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:9502:x1875509206093952:12345-0@lo:502: Request processed in 87us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625102.003228:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788625102.004123:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206093952:0@lo:502: 00000040:00080000:0.0:1788625102.004319:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788625102.004344:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788625102.004672:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788625102.004699:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788625102.004724:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788625102.004802:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788625102.004824:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788625102.004838:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788625102.004852:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788625102.004867:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788625102.004880:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788625102.004891:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788625102.004904:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788625102.004916:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788625102.004929:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788625102.004942:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788625102.004954:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788625102.004965:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788625102.004976:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788625102.004987:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788625102.004998:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788625102.005010:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788625102.005022:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788625102.005035:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788625102.005065:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788625102.005080:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788625102.005093:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788625102.005105:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788625102.005119:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788625102.005132:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788625102.005144:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788625102.005157:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788625102.005168:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788625102.005180:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788625102.005193:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788625102.005206:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788625102.005218:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1788625102.005240:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788625102.005253:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1788625102.005265:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1788625102.005287:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1788625102.005303:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1788625102.005316:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1788625102.005329:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1788625102.005343:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1788625102.005717:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1788625102.005817:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206094080:0@lo:502: 00000100:00100000:0.0:1788625102.005887:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625102.005965:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c4da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625102.006004:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206094080 00000100:00100000:2.0:1788625102.006016:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206094080 00000100:00100000:2.0:1788625102.006090:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788625102.006099:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:9502:x1875509206094080:12345-0@lo:502: 00000100:00100000:2.0:1788625102.006237:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:9502:x1875509206094080:12345-0@lo:502: Request processed in 138us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625102.006245:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788625102.006324:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206094080:0@lo:502: 00000040:00080000:0.0:1788625102.006443:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1788625102.006451:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1788625102.007181:0:9519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788625102.007196:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99887cb1cd40) 00000020:00000080:0.0:1788625102.007218:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1788625102.007302:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9988449c9000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788625102.007307:0:9519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9988449c9000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788625102.007309:0:9519:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9988449c9000 3 00010000:00080000:0.0:1788625102.007335:0:9519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99887cb8f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.114@tcp at head 00010000:00010000:0.0:1788625102.013290:0:9519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1788625102.013810:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788625102.013855:0:9519:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788625102.013868:0:9519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2d2e3b3f34a7a1bc 00000100:00080000:0.0:1788625102.013878:0:9519:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788625102.013884:0:9519:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99887cb8f800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625102.013919:0:9519:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998741dc0000 x1875509206094208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625102.013949:0:9519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788625102.014033:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206094208:0@lo:38: 00000100:00100000:1.0:1788625102.014119:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625102.014491:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206094720:0@lo:400: 00000100:00100000:3.0:1788625102.014546:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625102.014572:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206095232:0@lo:400: 00000100:00100000:3.0:1788625102.014595:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625102.014613:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788625102.014618:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206094336:0@lo:400: 00000100:00100000:3.0:1788625102.014639:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625102.014656:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206094848:0@lo:400: 00000100:00100000:3.0:1788625102.014686:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625102.014723:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206094464:0@lo:400: 00000100:00100000:0.0:1788625102.014734:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206094208 00000100:00100000:0.0:1788625102.014741:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206094208 00000100:00100000:0.0:1788625102.014763:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206094336 00000100:00100000:0.0:1788625102.014765:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206094336 00000100:00100000:0.0:1788625102.014785:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206094848 00000100:00100000:0.0:1788625102.014788:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206094848 00000100:00100000:0.0:1788625102.014813:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788625102.014817:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625102.014822:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206094336:12345-0@lo:400: 00000100:00100000:3.0:1788625102.014835:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206094976:0@lo:400: 00000100:00100000:3.0:1788625102.014856:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625102.014868:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206094336:12345-0@lo:400: Request processed in 47us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625102.014869:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788625102.014874:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206094592:0@lo:400: 00000100:00100000:0.0:1788625102.014875:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788625102.014887:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206094976 00000100:00100000:0.0:1788625102.014890:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206094976 00000100:00100000:3.0:1788625102.014892:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625102.014902:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206095104:0@lo:400: 00000100:00100000:0.0:1788625102.014904:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206094592 00000100:00100000:0.0:1788625102.014905:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206094592 00000100:00100000:0.0:1788625102.014917:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788625102.014920:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625102.014922:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206094848:12345-0@lo:400: 00000100:00100000:0.0:1788625102.014946:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206094848:12345-0@lo:400: Request processed in 24us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625102.014947:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206094720 00000100:00100000:3.0:1788625102.014951:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206094720 00000100:00100000:0.0:1788625102.014952:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788625102.014962:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788625102.014967:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206094976:12345-0@lo:400: 00000100:00100000:3.0:1788625102.014970:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206094464 00000100:00100000:3.0:1788625102.014972:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206094464 00000100:00100000:3.0:1788625102.014995:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788625102.014995:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206094976:12345-0@lo:400: Request processed in 28us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625102.015000:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206094720:12345-0@lo:400: 00000100:00100000:0.0:1788625102.015001:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788625102.015010:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788625102.015021:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206094592:12345-0@lo:400: 00000100:00100000:3.0:1788625102.015030:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206094720:12345-0@lo:400: Request processed in 30us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625102.015036:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788625102.015044:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206094592:12345-0@lo:400: Request processed in 23us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625102.015049:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788625102.015049:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788625102.015054:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206094464:12345-0@lo:400: 00000100:00100000:0.0:1788625102.015058:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788625102.015061:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875509206094208:12345-0@lo:38: 00000100:00100000:3.0:1788625102.015077:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206094464:12345-0@lo:400: Request processed in 23us (259us total) trans 0 rc 0/0 00010000:00080000:0.0:1788625102.015081:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000100:00100000:3.0:1788625102.015082:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788625102.015098:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206095232 00000100:00100000:3.0:1788625102.015101:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206095232 00000020:00000080:0.0:1788625102.015111:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2d2e3b3f34a7a1c3 00000100:00100000:3.0:1788625102.015125:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206095104 00000100:00100000:3.0:1788625102.015127:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206095104 00000004:00100000:0.0:1788625102.015129:0:6511:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788625102.015145:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788625102.015151:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206095232:12345-0@lo:400: 00000100:00080000:0.0:1788625102.015164:0:6511:0:(import.c:65:import_set_state_nolock()) ffff99887ca96000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625102.015179:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206095232:12345-0@lo:400: Request processed in 29us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625102.015185:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788625102.015196:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625102.015197:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875509206094208:12345-0@lo:38: Request processed in 135us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625102.015201:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206095104:12345-0@lo:400: 00000100:00100000:0.0:1788625102.015204:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788625102.016629:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998741dc0000 x1875509206094208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625102.016643:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788625102.016654:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788625102.016663:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788625102.016758:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788625102.016822:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887cb8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788625102.016832:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206094208:0@lo:38: 00000100:00100000:3.0:1788625102.016860:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206095104:12345-0@lo:400: Request processed in 1655us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625102.016871:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788625102.016906:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625102.016912:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625102.016915:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788625102.016956:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742d27800 x1875509206094592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000004:0.0:1788625102.016967:0:9519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:3.0:1788625102.016979:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206094592:0@lo:400: 00000020:00000080:0.0:1788625102.016984:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff99887cb18000) 00010000:00080000:3.0:1788625102.016996:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742d25180 x1875509206095104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625102.017004:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206095104:0@lo:400: 00000020:00000080:0.0:1788625102.017009:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:3.0:1788625102.017016:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206094464:0@lo:400: 00010000:00080000:3.0:1788625102.017030:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742d26a00 x1875509206094976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625102.017037:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206094976:0@lo:400: 00010000:00080000:3.0:1788625102.017070:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742d24700 x1875509206094336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625102.017079:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206094336:0@lo:400: 00010000:00080000:3.0:1788625102.017090:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742d25500 x1875509206094848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625102.017097:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206094848:0@lo:400: 00000020:01000004:0.0:1788625102.017097:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9988449c9000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788625102.017105:0:9519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9988449c9000 from lustre-OST0001, refs=3 00000100:00100000:3.0:1788625102.017113:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206094720:0@lo:400: 00000020:01000004:0.0:1788625102.017116:0:9519:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9988449c9000 3 00010000:00080000:3.0:1788625102.017126:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742d25880 x1875509206095232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625102.017134:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206095232:0@lo:400: 00010000:00080000:0.0:1788625102.017147:0:9519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99887cb8c800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.114@tcp at head 00000100:00100000:1.0:1788625102.018577:0:9520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5d180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9520:1875509206095360:0@lo:901: 00000100:00100000:1.0:1788625102.018641:0:9520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625102.018680:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206095360 00000100:00100000:1.0:1788625102.018685:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206095360 00000100:00100000:1.0:1788625102.018737:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788625102.018746:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9520:x1875509206095360:12345-0@lo:901: 00000100:00100000:1.0:1788625102.018827:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9520:x1875509206095360:12345-0@lo:901: Request processed in 81us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625102.018834:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788625102.018859:0:9520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433bf600 going to sleep for 11 seconds 00010000:00080000:1.0:1788625102.018878:0:9520:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998742c5d180 x1875509206095360/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788625118 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625102.018890:0:9520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5d180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9520:1875509206095360:0@lo:901: 00010000:00010000:0.0:1788625102.019073:0:9519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1788625102.019271:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788625102.019314:0:9519:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788625102.019326:0:9519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2d2e3b3f34a7a1d1 00000100:00080000:0.0:1788625102.019334:0:9519:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788625102.019339:0:9519:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99887cb8c800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625102.019362:0:9519:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998741dc0000 x1875509206095488/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625102.019389:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875509206095488:0@lo:38: 00000100:00100000:0.0:1788625102.019431:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625102.019491:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206095488 00000100:00100000:0.0:1788625102.019496:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206095488 00000100:00100000:0.0:1788625102.019545:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788625102.019551:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875509206095488:12345-0@lo:38: 00010000:00080000:0.0:1788625102.019572:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:0.0:1788625102.019619:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2d2e3b3f34a7a1d8 00000004:00100000:0.0:1788625102.019635:0:6511:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788625102.019670:0:6511:0:(import.c:65:import_set_state_nolock()) ffff998741e08000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625102.019712:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875509206095488:12345-0@lo:38: Request processed in 160us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625102.019719:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788625102.019748:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998741dc0000 x1875509206095488/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625102.019757:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788625102.019824:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788625102.019837:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788625102.019841:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788625102.019844:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887cb8c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788625102.019850:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875509206095488:0@lo:38: 00000100:00080000:0.0:1788625102.019877:0:9519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788625102.020110:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788625102.023177:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1788625102.023697:0:9502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788625102.023929:0:9502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788625102.024153:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a7a1a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a1ae expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.024166:0:9502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a7a1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a1ae expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788625102.024217:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788625102.024220:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788625102.024221:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625102.024222:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625102.024224:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625102.024225:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625102.024227:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625102.024228:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788625102.024230:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788625102.024232:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625102.024233:0:9502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788625102.024237:0:9502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788625102.024240:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788625102.024241:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788625102.024242:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625102.024243:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625102.024244:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625102.024245:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625102.024246:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625102.024247:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788625102.024249:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788625102.024254:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625102.024255:0:9502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788625102.024282:0:9502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788625102.025214:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206095616:0@lo:253: 00000100:00100000:2.0:1788625102.025361:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625102.025410:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff998844faee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625102.025482:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206095616 00000100:00100000:0.0:1788625102.025492:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206095616 00000100:00100000:0.0:1788625102.025567:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788625102.025576:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:9502:x1875509206095616:12345-0@lo:253: 20000000:01000000:0.0:1788625102.025607:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788625102.025622:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788625102.030935:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788625102.030952:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788625102.030965:0:6527:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788625102.030971:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788625102.030989:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a1df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.031004:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a0d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a0ce expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.031010:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a11b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a114 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.031015:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a1df lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.031048:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a11b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a114 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.031061:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a11b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a114 expref: 17 pid: 6506 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625102.031073:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875509206095744:0@lo:104: 00000100:00100000:2.0:1788625102.031138:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625102.031342:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:9502:x1875509206095616:12345-0@lo:253: Request processed in 5765us (5978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625102.031353:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00010000:2.0:1788625102.031398:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a0d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0ce expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.031418:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a0d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0ce expref: 16 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625102.031450:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875509206095872:0@lo:104: 00000100:00100000:3.0:1788625102.031458:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6544f02a-cd81-4e03-84c5-408bee21ab7a:9502:1875509206095616:0@lo:253: 10000000:01000000:3.0:1788625102.031472:0:9502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000100:00100000:2.0:1788625102.031477:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1788625102.031484:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788625102.031486:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788625102.031488:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625102.031489:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625102.031490:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625102.031492:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625102.031493:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:2.0:1788625102.031512:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff998844fae900 going to sleep for 11 seconds 00000100:00100000:1.0:1788625102.031769:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206095744 00000100:00100000:1.0:1788625102.031776:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206095744 00000100:00100000:1.0:1788625102.031820:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206095872 00000100:00100000:1.0:1788625102.031823:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206095872 00000100:00100000:1.0:1788625102.031837:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788625102.031848:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:6527:x1875509206095744:12345-0@lo:104: 00010000:00010000:1.0:1788625102.031861:0:8440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887c995a00/0x2d2e3b3f34a7a114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a11b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625102.031869:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788625102.031883:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:6527:x1875509206095872:12345-0@lo:104: 00010000:00010000:2.0:1788625102.031895:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887c994400/0x2d2e3b3f34a7a0ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a0d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625102.031930:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788625102.031937:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:6527:x1875509206095744:12345-0@lo:104: Request processed in 92us (799us total) trans 0 rc 0/0 00010000:00010000:2.0:1788625102.031944:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788625102.031945:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788625102.031953:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:6527:x1875509206095872:12345-0@lo:104: Request processed in 74us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625102.031961:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788625102.031971:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625102.031979:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887c995a00/0x2d2e3b3f34a7a114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a11b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625102.031988:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995a00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625102.031992:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887c995a00/0x2d2e3b3f34a7a114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a11b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625102.032001:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887c995a00/0x2d2e3b3f34a7a114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a11b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625102.032009:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887c995a00/0x2d2e3b3f34a7a114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a11b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625102.032025:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625102.032058:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887c995a00/0x2d2e3b3f34a7a114 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a11b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625102.032073:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625102.032096:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887c995a00/0x2d2e3b3f34a7a114 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a11b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625102.032103:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887c995a00/0x2d2e3b3f34a7a114 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a11b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625102.032114:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625102.032118:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887c994400/0x2d2e3b3f34a7a0ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a0d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625102.032123:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994400 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625102.032127:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887c994400/0x2d2e3b3f34a7a0ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a0d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625102.032133:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887c994400/0x2d2e3b3f34a7a0ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a0d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625102.032139:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887c994400/0x2d2e3b3f34a7a0ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a0d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625102.032144:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625102.032169:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887c994400/0x2d2e3b3f34a7a0ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a0d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625102.032175:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625102.032190:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887c994400/0x2d2e3b3f34a7a0ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a0d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625102.032197:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887c994400/0x2d2e3b3f34a7a0ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a0d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625102.032217:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625102.032219:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625102.032221:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625102.032235:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206096000:0@lo:103: 00000100:00100000:1.0:1788625102.032266:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625102.032314:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206096000 00000100:00100000:2.0:1788625102.032320:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206096000 00000100:00100000:1.0:1788625102.032325:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875509206095744:0@lo:104: 00000100:00100000:1.0:1788625102.032336:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1875509206095872:0@lo:104: 00010000:00010000:2.0:1788625102.032343:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a11b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a114 expref: 17 pid: 6506 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625102.032355:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a1df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625102.032371:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788625102.032380:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:3636:x1875509206096000:12345-0@lo:103: 00010000:00010000:2.0:1788625102.032390:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625102.032395:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a11b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a114 expref: 17 pid: 6506 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.032406:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a11b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a114 expref: 17 pid: 6506 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625102.032469:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625102.032560:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a11b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a114 expref: 17 pid: 6506 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.032588:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625102.032618:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206096128:0@lo:103: 00000100:00100000:2.0:1788625102.032626:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:3636:x1875509206096000:12345-0@lo:103: Request processed in 245us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625102.032635:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788625102.032652:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1788625102.032894:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788625102.032896:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788625102.032898:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625102.032900:0:9502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788625102.032900:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206096128 00000100:00100000:2.0:1788625102.032906:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206096128 00000020:02000000:3.0:1788625102.032914:0:9502:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788625102.032925:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a0d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0ce expref: 16 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625102.032952:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788625102.032959:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:3637:x1875509206096128:12345-0@lo:103: 00010000:00010000:2.0:1788625102.032967:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625102.032971:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a0d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0ce expref: 16 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.032978:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a0d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0ce expref: 16 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.032988:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a0d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a0ce expref: 16 pid: 6503 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.032998:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a1df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.033005:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a1df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788625102.033017:0:9513:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004361819s 00010000:00010000:2.0:1788625102.033022:0:9513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a1df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.033035:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a1df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.033042:0:9513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a1df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.033049:0:9513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a1df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.033054:0:9513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625102.033058:0:9513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a1df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.033066:0:9513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a1df lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.033078:0:9513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a1df lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625102.033086:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625102.033117:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:3637:x1875509206096128:12345-0@lo:103: Request processed in 160us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625102.033124:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788625102.033177:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206096000:0@lo:103: 00010000:00010000:1.0:1788625102.033198:0:6527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a1df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625102.033207:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a1df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625102.033213:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a1df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625102.034634:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206096128:0@lo:103: 00080000:10000000:3.0:1788625102.037969:0:9502:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788625102.038198:0:9502:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788625102.038377:0:9502:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788625102.038713:0:9502:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788625102.038918:0:9502:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788625102.039222:0:9502:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788625102.040268:0:9502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788625102.049120:0:9502:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788625102.049130:0:9502:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788625102.049169:0:9502:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788625102.049215:0:9502:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788625102.049237:0:9502:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788625102.049255:0:9502:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788625102.050122:0:9502:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625102.050318:0:9502:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788625102.924689:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788625102.976143:0:9575:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788625102.976726:0:9575:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788625103.947758:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625104.651699:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625104.652110:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206096256:0@lo:41: 00000100:00100000:3.0:1788625104.652184:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625104.652299:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206096256 00000100:00100000:1.0:1788625104.652308:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206096256 00000100:00100000:1.0:1788625104.653556:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788625104.653571:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206096256:12345-0@lo:41: 00000004:00000024:1.0:1788625104.653613:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788625104.653681:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206096256:12345-0@lo:41: Request processed in 114us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625104.653694:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788625104.653990:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206096256:0@lo:41: 00010000:00010000:2.0:1788625104.971762:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625105.163900:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206096384:0@lo:13: 00000100:00100000:3.0:1788625105.163975:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625105.164053:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206096384 00000100:00100000:3.0:1788625105.164087:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206096384 00000100:00100000:1.0:1788625105.164110:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206096512:0@lo:13: 00000100:00100000:1.0:1788625105.164141:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625105.164150:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206096512 00000100:00100000:3.0:1788625105.164153:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206096512 00000100:00100000:3.0:1788625105.164171:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625105.164180:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206096384:12345-0@lo:13: 00002000:00000024:3.0:1788625105.164209:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625105.164264:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206096384:12345-0@lo:13: Request processed in 85us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625105.164271:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625105.164290:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788625105.164296:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206096512:12345-0@lo:13: 00002000:00000024:3.0:1788625105.164306:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1788625105.164314:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743684a80 x1875509206096384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625105.164331:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206096512:12345-0@lo:13: Request processed in 36us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625105.164332:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206096384:0@lo:13: 00000100:00100000:3.0:1788625105.164337:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788625105.164350:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788625105.164357:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c5d180 x1875509206096512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625105.164368:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206096512:0@lo:13: 00010000:00010000:2.0:1788625105.997712:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625106.196950:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625106.196978:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206096640:0@lo:41: 00000100:00100000:0.0:1788625106.197054:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625106.197151:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206096640 00000100:00100000:0.0:1788625106.197160:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206096640 00000100:00100000:0.0:1788625106.197220:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788625106.197229:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206096640:12345-0@lo:41: 00000004:00000024:0.0:1788625106.197267:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788625106.197890:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206096640:12345-0@lo:41: Request processed in 84us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625106.197899:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788625106.197946:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206096640:0@lo:41: 00010000:00010000:2.0:1788625107.021673:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625107.214267:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206096768:0@lo:400: 00000100:00100000:0.0:1788625107.215509:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625107.215597:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206097280:0@lo:400: 00000100:00100000:0.0:1788625107.216286:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625107.216321:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206097792:0@lo:400: 00000100:00100000:0.0:1788625107.216363:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625107.216396:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788625107.216403:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206097152:0@lo:400: 00000100:00100000:0.0:1788625107.216429:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625107.216461:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206097664:0@lo:400: 00000100:00100000:0.0:1788625107.216486:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625107.216535:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206097792 00000100:00100000:0.0:1788625107.216541:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206096896:0@lo:400: 00000100:00100000:3.0:1788625107.216544:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206097792 00000100:00100000:0.0:1788625107.216569:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625107.216589:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206097408:0@lo:400: 00000100:00100000:0.0:1788625107.216613:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625107.216618:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206097664 00000100:00100000:3.0:1788625107.216623:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206097664 00000100:00100000:0.0:1788625107.216666:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206097920:0@lo:400: 00000100:00100000:0.0:1788625107.216700:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625107.216714:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788625107.216720:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206097024:0@lo:400: 00000100:00100000:2.0:1788625107.216728:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206096768 00000100:00100000:2.0:1788625107.216735:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206096768 00000100:00100000:0.0:1788625107.216742:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625107.216760:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206097536:0@lo:400: 00000100:00100000:0.0:1788625107.216793:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625107.216804:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206098048:0@lo:400: 00000100:00100000:0.0:1788625107.216822:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625107.216861:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206097280 00000100:00100000:0.0:1788625107.216866:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206097280 00000100:00100000:0.0:1788625107.216888:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206097024 00000100:00100000:0.0:1788625107.216891:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206097024 00000100:00100000:3.0:1788625107.216968:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788625107.216979:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206097792:12345-0@lo:400: 00000100:00100000:3.0:1788625107.217047:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206097792:12345-0@lo:400: Request processed in 70us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625107.217055:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788625107.217074:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625107.217081:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206097664:12345-0@lo:400: 00000100:00100000:3.0:1788625107.217109:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206097664:12345-0@lo:400: Request processed in 29us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625107.217122:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788625107.217140:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625107.217192:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788625107.217207:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:3638:x1875509206096768:12345-0@lo:400: 00000100:00100000:2.0:1788625107.217246:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:3638:x1875509206096768:12345-0@lo:400: Request processed in 41us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625107.217253:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788625107.218004:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788625107.218014:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206097280:12345-0@lo:400: 00000100:00100000:0.0:1788625107.218060:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206097280:12345-0@lo:400: Request processed in 49us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625107.218067:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788625107.218081:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788625107.218088:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206097024:12345-0@lo:400: 00000100:00100000:0.0:1788625107.218133:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206097024:12345-0@lo:400: Request processed in 46us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625107.218140:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788625107.218168:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206097152 00000100:00100000:0.0:1788625107.218173:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206097152 00000100:00100000:0.0:1788625107.218193:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206096896 00000100:00100000:0.0:1788625107.218196:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206096896 00000100:00100000:0.0:1788625107.218295:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206097408 00000100:00100000:0.0:1788625107.218299:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206097408 00000100:00100000:0.0:1788625107.218353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206097920 00000100:00100000:0.0:1788625107.218358:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206097920 00000100:00080000:3.0:1788625107.218374:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625107.218374:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206097536 00000100:00100000:0.0:1788625107.218379:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206097536 00000100:00080000:3.0:1788625107.218393:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625107.218402:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206098048 00000100:00100000:0.0:1788625107.218406:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206098048 00000100:00100000:0.0:1788625107.218437:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788625107.218444:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206097152:12345-0@lo:400: 00000100:00100000:2.0:1788625107.218509:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206097024:0@lo:400: 00000100:00080000:3.0:1788625107.218549:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625107.218633:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206097152:12345-0@lo:400: Request processed in 188us (2201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625107.218641:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788625107.218656:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788625107.218662:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206096896:12345-0@lo:400: 00000100:00100000:0.0:1788625107.218704:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206096896:12345-0@lo:400: Request processed in 43us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625107.218710:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788625107.218721:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788625107.218727:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206097408:12345-0@lo:400: 00000100:00100000:0.0:1788625107.218750:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206097408:12345-0@lo:400: Request processed in 24us (2137us total) trans 0 rc 0/0 00010000:00080000:3.0:1788625107.218786:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4dd180 x1875509206096896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625107.218797:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206096896:0@lo:400: 00010000:00080000:3.0:1788625107.218808:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4dea00 x1875509206097408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625107.218816:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206097408:0@lo:400: 00000100:00100000:0.0:1788625107.218822:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788625107.218842:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788625107.218874:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788625107.218883:0:6512:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788625107.218950:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206097920:12345-0@lo:400: 00000100:00100000:0.0:1788625107.218993:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206097920:12345-0@lo:400: Request processed in 49us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625107.219000:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788625107.219013:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788625107.219019:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206097536:12345-0@lo:400: 00000100:00100000:0.0:1788625107.219058:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206097536:12345-0@lo:400: Request processed in 39us (2263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625107.219064:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788625107.219078:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788625107.219085:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206098048:12345-0@lo:400: 00000100:00100000:0.0:1788625107.219183:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206098048:12345-0@lo:400: Request processed in 98us (2360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625107.219189:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788625107.219222:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4dd880 x1875509206097152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625107.219233:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206097152:0@lo:400: 00010000:00080000:0.0:1788625107.219249:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4dce00 x1875509206097664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625107.219258:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206097664:0@lo:400: 00000100:00100000:0.0:1788625107.219270:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206096768:0@lo:400: 00000100:00100000:0.0:1788625107.219280:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206097280:0@lo:400: 00010000:00080000:0.0:1788625107.219290:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4ded80 x1875509206097792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625107.219298:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206097792:0@lo:400: 00010000:00080000:3.0:1788625107.219384:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4ddf80 x1875509206097536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625107.219393:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206097536:0@lo:400: 00010000:00080000:3.0:1788625107.219407:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743837b80 x1875509206098048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625107.219414:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206098048:0@lo:400: 00010000:00080000:3.0:1788625107.219425:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9988449ae300 x1875509206097920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625107.219433:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206097920:0@lo:400: 00000001:02000400:1.0:1788625107.613828:0:9866:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788625108.043932:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788625108.407212:0:9918:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788625108.407623:0:9918:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788625109.068799:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625109.771919:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625109.771957:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206098176:0@lo:41: 00000100:00100000:1.0:1788625109.772051:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625109.772376:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206098176 00000100:00100000:0.0:1788625109.772385:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206098176 00000100:00100000:0.0:1788625109.772458:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788625109.772467:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206098176:12345-0@lo:41: 00000004:00000024:0.0:1788625109.772570:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788625109.772629:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206098176:12345-0@lo:41: Request processed in 163us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625109.772637:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788625109.773195:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206098176:0@lo:41: 00010000:00010000:2.0:1788625110.097121:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625110.283912:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625110.283951:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206098304:0@lo:13: 00000100:00100000:3.0:1788625110.284039:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625110.284097:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206098304 00000100:00100000:1.0:1788625110.284108:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206098304 00000100:00100000:3.0:1788625110.284131:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206098432:0@lo:13: 00000100:00100000:3.0:1788625110.284161:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625110.284169:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206098432 00000100:00100000:1.0:1788625110.284174:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206098432 00000100:00080000:3.0:1788625110.284198:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625110.284202:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788625110.284214:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206098304:12345-0@lo:13: 00002000:00000024:1.0:1788625110.284247:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625110.284321:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206098304:12345-0@lo:13: Request processed in 110us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625110.284329:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788625110.284371:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625110.284378:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206098432:12345-0@lo:13: 00002000:00000024:1.0:1788625110.284390:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625110.284419:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206098432:12345-0@lo:13: Request processed in 43us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625110.284426:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788625110.284478:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743685880 x1875509206098432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625110.284499:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206098432:0@lo:13: 00010000:00080000:3.0:1788625110.284549:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c5ce00 x1875509206098304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625110.284560:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206098304:0@lo:13: 10000000:01000000:0.0:1788625110.802971:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788625110.802979:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998878127800 from 39 10000000:01000000:0.0:1788625110.802985:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788625110.803025:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a1e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.803038:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a1e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.803049:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a1e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625110.803071:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743836680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206098560:0@lo:101: 00000100:00100000:0.0:1788625110.803134:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.804876:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437dab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625110.807286:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206098560 00000100:00100000:2.0:1788625110.807303:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206098560 00000100:00100000:2.0:1788625110.807366:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788625110.807378:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:6508:x1875509206098560:12345-0@lo:101: 00010000:00010000:2.0:1788625110.807396:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625110.807416:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a1ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a1e6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.807447:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a1ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a1e6 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.807459:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a1ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a1e6 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.807469:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6000, rc 0) 00000100:00100000:2.0:1788625110.807711:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206098560:12345-0@lo:101: Request processed in 198us (4439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.807720:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788625110.808565:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743836680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206098560:0@lo:101: 00010000:00010000:1.0:1788625110.808589:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a1e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a1ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625110.808600:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a1e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a1ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625110.808690:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206098688:0@lo:501: 00000100:00100000:1.0:1788625110.808737:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625110.808783:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866c649c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625110.808976:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206098688 00000100:00100000:3.0:1788625110.808983:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206098688 00000100:00100000:3.0:1788625110.809028:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788625110.809046:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206098688:12345-0@lo:501: 00000100:00100000:3.0:1788625110.809348:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206098688:12345-0@lo:501: Request processed in 312us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.809356:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788625110.810747:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206098688:0@lo:501: 00000100:00100000:0.0:1788625110.810800:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206098816:0@lo:503: 00000100:00100000:0.0:1788625110.810856:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.810893:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625110.811672:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206098816 00000100:00100000:2.0:1788625110.811680:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206098816 00000100:00100000:2.0:1788625110.811735:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788625110.811744:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206098816:12345-0@lo:503: 00000100:00100000:2.0:1788625110.811869:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206098816:12345-0@lo:503: Request processed in 126us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.811877:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788625110.812308:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206098816:0@lo:503: 00000100:00100000:2.0:1788625110.819907:0:9997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:9997:1875509206098944:0@lo:502: 00000100:00100000:2.0:1788625110.820003:0:9997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.820052:0:9997:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.820224:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206098944 00000100:00100000:0.0:1788625110.820232:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206098944 00000100:00100000:0.0:1788625110.820292:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788625110.820302:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9997:x1875509206098944:12345-0@lo:502: 00000100:00100000:0.0:1788625110.820451:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9997:x1875509206098944:12345-0@lo:502: Request processed in 150us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.820460:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788625110.821491:0:9997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:9997:1875509206098944:0@lo:502: 00000100:00100000:2.0:1788625110.821668:0:9997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:9997:1875509206099072:0@lo:502: 00000100:00100000:2.0:1788625110.821720:0:9997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.821754:0:9997:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.822169:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206099072 00000100:00100000:0.0:1788625110.822176:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206099072 00000100:00100000:0.0:1788625110.822222:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788625110.822231:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9997:x1875509206099072:12345-0@lo:502: 00000100:00100000:0.0:1788625110.822351:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:9997:x1875509206099072:12345-0@lo:502: Request processed in 122us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.822359:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788625110.823512:0:9997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:9997:1875509206099072:0@lo:502: 00000040:00080000:2.0:1788625110.823952:0:9997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788625110.824122:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788625110.824146:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788625110.824159:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a1e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a1ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.824172:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a1e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a1ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625110.824184:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788625110.824186:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788625110.824189:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788625110.824222:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c994a00/0x2d2e3b3f34a7a1f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.824230:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887c994a00/0x2d2e3b3f34a7a1f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.824241:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887c994a00/0x2d2e3b3f34a7a1f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625110.824283:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206099200:0@lo:101: 00000100:00100000:0.0:1788625110.824343:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.824461:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da240 going to sleep for 11 seconds 00000100:00100000:2.0:1788625110.826877:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206099200 00000100:00100000:2.0:1788625110.826891:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206099200 00000100:00100000:2.0:1788625110.826958:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788625110.826969:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206099200:12345-0@lo:101: 00010000:00010000:2.0:1788625110.826987:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625110.827006:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887cac7000/0x2d2e3b3f34a7a1fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a1f4 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.827036:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac7000/0x2d2e3b3f34a7a1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a1f4 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.827062:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887cac7000/0x2d2e3b3f34a7a1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a1f4 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.827071:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7000, rc 0) 00000100:00100000:2.0:1788625110.827145:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206099200:12345-0@lo:101: Request processed in 178us (2801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.827152:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788625110.827293:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206099200:0@lo:101: 00010000:00010000:0.0:1788625110.827313:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887c994a00/0x2d2e3b3f34a7a1f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a1fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.827323:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887c994a00/0x2d2e3b3f34a7a1f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a1fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625110.827405:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206099328:0@lo:501: 00000100:00100000:0.0:1788625110.827439:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.827469:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da240 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.827485:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206099328 00000100:00100000:0.0:1788625110.827489:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206099328 00000100:00100000:0.0:1788625110.827512:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788625110.827541:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206099328:12345-0@lo:501: 00000100:00100000:0.0:1788625110.827936:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206099328:12345-0@lo:501: Request processed in 395us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.827943:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788625110.828004:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206099328:0@lo:501: 00000100:00100000:2.0:1788625110.828033:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206099456:0@lo:503: 00000100:00100000:2.0:1788625110.828074:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.828097:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.828135:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206099456 00000100:00100000:0.0:1788625110.828140:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206099456 00000100:00100000:0.0:1788625110.828168:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788625110.828175:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206099456:12345-0@lo:503: 00000100:00100000:0.0:1788625110.828270:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206099456:12345-0@lo:503: Request processed in 95us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.828287:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788625110.828309:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206099456:0@lo:503: 00000100:00100000:2.0:1788625110.829374:0:9999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:9999:1875509206099584:0@lo:502: 00000100:00100000:2.0:1788625110.829419:0:9999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.829446:0:9999:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788625110.829731:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206099584 00000100:00100000:1.0:1788625110.829873:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206099584 00000100:00100000:1.0:1788625110.830019:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788625110.830031:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:9999:x1875509206099584:12345-0@lo:502: 00000100:00100000:1.0:1788625110.830176:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:9999:x1875509206099584:12345-0@lo:502: Request processed in 147us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625110.830185:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788625110.830279:0:9999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:9999:1875509206099584:0@lo:502: 00000020:01000000:2.0:1788625110.830305:0:9999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625110.830314:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625110.830316:0:9999:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788625110.830320:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788625110.830322:0:9999:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788625110.830339:0:9999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:9999:1875509206099712:0@lo:502: 00000100:00100000:2.0:1788625110.830450:0:9999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.831182:0:9999:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.831188:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206099712 00000100:00100000:0.0:1788625110.831195:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206099712 00000100:00100000:0.0:1788625110.831235:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788625110.831246:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:9999:x1875509206099712:12345-0@lo:502: 00000100:00100000:0.0:1788625110.831373:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:9999:x1875509206099712:12345-0@lo:502: Request processed in 129us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.831380:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788625110.831472:0:9999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:9999:1875509206099712:0@lo:502: 00000020:01000000:2.0:1788625110.831496:0:9999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625110.831507:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625110.831509:0:9999:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788625110.831514:0:9999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788625110.831724:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788625110.831745:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788625110.831756:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c994a00/0x2d2e3b3f34a7a1f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a1fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625110.831768:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887c994a00/0x2d2e3b3f34a7a1f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a1fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625110.831778:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788625110.831781:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99886c323000 from 39 10000000:01000000:3.0:1788625110.831784:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788625110.831817:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683800/0x2d2e3b3f34a7a202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625110.831825:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b683800/0x2d2e3b3f34a7a202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625110.831834:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b683800/0x2d2e3b3f34a7a202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625110.831851:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206099840:0@lo:101: 00000100:00100000:3.0:1788625110.831960:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625110.831991:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206099840 00000100:00100000:1.0:1788625110.831998:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206099840 00000100:00100000:3.0:1788625110.832001:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c2780 going to sleep for 11 seconds 00000100:00100000:1.0:1788625110.832071:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788625110.832085:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206099840:12345-0@lo:101: 00010000:00010000:1.0:1788625110.832100:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625110.832122:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998859be8e00/0x2d2e3b3f34a7a209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a202 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625110.832146:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998859be8e00/0x2d2e3b3f34a7a209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a202 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625110.832158:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998859be8e00/0x2d2e3b3f34a7a209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a202 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625110.832166:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be8e00, rc 0) 00000100:00100000:1.0:1788625110.832205:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206099840:12345-0@lo:101: Request processed in 121us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625110.832211:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788625110.832253:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206099840:0@lo:101: 00010000:00010000:3.0:1788625110.832282:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b683800/0x2d2e3b3f34a7a202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a209 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625110.832290:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b683800/0x2d2e3b3f34a7a202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a209 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625110.832465:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206099968:0@lo:501: 00000100:00100000:3.0:1788625110.832490:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.832599:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206099968 00000100:00100000:2.0:1788625110.832604:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206099968 00000100:00100000:3.0:1788625110.832621:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625110.832638:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788625110.832647:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206099968:12345-0@lo:501: 00000100:00100000:2.0:1788625110.832772:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206099968:12345-0@lo:501: Request processed in 126us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.832779:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788625110.833268:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206099968:0@lo:501: 00000100:00100000:3.0:1788625110.833305:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206100096:0@lo:503: 00000100:00100000:3.0:1788625110.833353:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625110.833513:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.833589:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206100096 00000100:00100000:0.0:1788625110.833594:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206100096 00000100:00100000:0.0:1788625110.833635:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788625110.833644:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206100096:12345-0@lo:503: 00000100:00100000:0.0:1788625110.833740:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206100096:12345-0@lo:503: Request processed in 98us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.833748:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788625110.834143:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206100096:0@lo:503: 00000100:00100000:3.0:1788625110.835877:0:10001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10001:1875509206100224:0@lo:502: 00000100:00100000:3.0:1788625110.835939:0:10001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.835998:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206100224 00000100:00100000:2.0:1788625110.836007:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206100224 00000100:00100000:3.0:1788625110.836008:0:10001:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625110.836122:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788625110.836133:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:10001:x1875509206100224:12345-0@lo:502: 00000100:00100000:2.0:1788625110.836277:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:10001:x1875509206100224:12345-0@lo:502: Request processed in 146us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.836284:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788625110.836434:0:10001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10001:1875509206100224:0@lo:502: 00000100:00100000:3.0:1788625110.836480:0:10001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10001:1875509206100352:0@lo:502: 00000100:00100000:3.0:1788625110.836511:0:10001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625110.841623:0:10001:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.841752:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206100352 00000100:00100000:0.0:1788625110.841763:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206100352 00000100:00100000:0.0:1788625110.841818:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788625110.841839:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:10001:x1875509206100352:12345-0@lo:502: 00000100:00100000:0.0:1788625110.842002:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:10001:x1875509206100352:12345-0@lo:502: Request processed in 175us (5489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.842010:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788625110.842081:0:10001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10001:1875509206100352:0@lo:502: 00000040:00080000:3.0:1788625110.842118:0:10001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788625110.842425:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788625110.842460:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788625110.842473:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683800/0x2d2e3b3f34a7a202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a209 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.842497:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b683800/0x2d2e3b3f34a7a202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a209 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625110.842509:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788625110.842511:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99886c323000 from 6 10000000:01000000:0.0:1788625110.842646:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788625110.842679:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.842686:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.842695:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625110.842714:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206100480:0@lo:101: 00000100:00100000:0.0:1788625110.842756:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.842776:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da240 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.842793:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206100480 00000100:00100000:0.0:1788625110.842797:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206100480 00000100:00100000:0.0:1788625110.842820:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788625110.842894:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206100480:12345-0@lo:101: 00010000:00010000:0.0:1788625110.842904:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625110.842918:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c995800/0x2d2e3b3f34a7a217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a210 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.842940:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c995800/0x2d2e3b3f34a7a217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a210 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.842963:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c995800/0x2d2e3b3f34a7a217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a210 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.842971:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995800, rc 0) 00000100:00100000:0.0:1788625110.843005:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:6508:x1875509206100480:12345-0@lo:101: Request processed in 179us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.843011:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788625110.843049:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206100480:0@lo:101: 00010000:00010000:0.0:1788625110.843064:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a217 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.843074:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a217 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625110.843184:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206100608:0@lo:256: 00000100:00100000:0.0:1788625110.843212:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.843243:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da240 going to sleep for 11 seconds 00000100:00100000:3.0:1788625110.843308:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206100608 00000100:00100000:3.0:1788625110.843312:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206100608 00000100:00100000:3.0:1788625110.843334:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788625110.843340:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:6508:x1875509206100608:12345-0@lo:256: 20000000:01000000:3.0:1788625110.843353:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788625110.843369:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788625110.843372:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788625110.843935:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206100608:0@lo:256: 10000000:01000000:0.0:1788625110.843982:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788625110.843990:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a217 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.843998:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a217 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625110.844006:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788625110.844013:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788625110.844016:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788625110.844036:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c995400/0x2d2e3b3f34a7a21e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.844044:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887c995400/0x2d2e3b3f34a7a21e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.844052:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887c995400/0x2d2e3b3f34a7a21e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625110.844065:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206100736:0@lo:101: 00000100:00100000:0.0:1788625110.844095:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.844194:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842c339c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625110.844294:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206100736 00000100:00100000:2.0:1788625110.844300:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206100736 00000100:00100000:2.0:1788625110.844384:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788625110.844392:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206100736:12345-0@lo:101: 00010000:00010000:2.0:1788625110.844400:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625110.844411:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a21e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.844431:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a21e expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625110.844581:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206100608:12345-0@lo:256: Request processed in 488us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.844591:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00010000:00010000:2.0:1788625110.844680:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a21e expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.844699:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7c00, rc 0) 00000100:00100000:2.0:1788625110.844733:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206100736:12345-0@lo:101: Request processed in 342us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.844739:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788625110.845965:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206100736:0@lo:101: 00010000:00010000:1.0:1788625110.845990:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887c995400/0x2d2e3b3f34a7a21e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a225 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625110.846004:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887c995400/0x2d2e3b3f34a7a21e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a225 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625110.846086:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206100864:0@lo:501: 00000100:00100000:1.0:1788625110.846135:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625110.846178:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998849b12840 going to sleep for 11 seconds 00000100:00100000:2.0:1788625110.846204:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206100864 00000100:00100000:2.0:1788625110.846210:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206100864 00000100:00100000:2.0:1788625110.846254:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788625110.846273:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206100864:12345-0@lo:501: 00000100:00100000:2.0:1788625110.846397:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206100864:12345-0@lo:501: Request processed in 125us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.846405:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788625110.846994:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206100864:0@lo:501: 00000100:00100000:1.0:1788625110.847031:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206100992:0@lo:503: 00000100:00100000:1.0:1788625110.847089:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625110.847123:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998849b12840 going to sleep for 11 seconds 00000100:00100000:1.0:1788625110.847139:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206100992 00000100:00100000:1.0:1788625110.847143:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206100992 00000100:00100000:1.0:1788625110.847185:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788625110.847193:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206100992:12345-0@lo:503: 00000100:00100000:1.0:1788625110.847304:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206100992:12345-0@lo:503: Request processed in 111us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625110.847311:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788625110.848621:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206100992:0@lo:503: 00000100:00100000:1.0:1788625110.851126:0:10002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10002:1875509206101120:0@lo:502: 00000100:00100000:1.0:1788625110.851210:0:10002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625110.851266:0:10002:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c4d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625110.851435:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206101120 00000100:00100000:2.0:1788625110.851451:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206101120 00000100:00100000:2.0:1788625110.851508:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788625110.851682:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:10002:x1875509206101120:12345-0@lo:502: 00000100:00100000:1.0:1788625110.851968:0:10002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10002:1875509206101120:0@lo:502: 00000020:01000000:1.0:1788625110.852004:0:10002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788625110.852012:0:10002:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788625110.852018:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625110.852021:0:10002:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788625110.852026:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788625110.852030:0:10002:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:01000000:1.0:1788625110.852053:0:10002:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788625110.852056:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788625110.852071:0:10002:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9988449d3380) 00000020:00000080:1.0:1788625110.852097:0:10002:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788625110.852103:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788625110.852205:0:10002:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788625110.852210:0:10002:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788625110.852218:0:10002:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a7a233 00010000:00080000:1.0:1788625110.852248:0:10002:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99887cb8a000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.114@tcp at head 00010000:00010000:1.0:1788625110.852757:0:10002:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1788625110.853008:0:10002:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788625110.853020:0:10002:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1788625110.853210:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:10002:x1875509206101120:12345-0@lo:502: Request processed in 1691us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.853219:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000040:00080000:1.0:1788625110.853768:0:10002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625110.854281:0:10002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625110.855076:0:10002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788625110.857083:0:10002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788625110.863580:0:10003:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788625110.863589:0:10003:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788625110.876931:0:10002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788625110.876948:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788625110.877003:0:10002:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788625110.877024:0:10002:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7a23a 00000100:00080000:1.0:1788625110.877033:0:10002:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788625110.877039:0:10002:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99887cb8a000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625110.877329:0:10002:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998742c5ce00 x1875509206101248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788625110.877352:0:10002:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788625110.877464:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206101248:0@lo:8: 00000100:00100000:2.0:1788625110.877512:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206101376:0@lo:400: 00000100:00100000:0.0:1788625110.877568:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.877610:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.877624:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206101248 00000100:00100000:0.0:1788625110.877632:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206101248 00000100:00100000:2.0:1788625110.877650:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206101888:0@lo:400: 00000100:00100000:0.0:1788625110.877674:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788625110.877680:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.877685:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3634:x1875509206101248:12345-0@lo:8: 00000100:00100000:2.0:1788625110.877707:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00010000:00080000:0.0:1788625110.877714:0:8868:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 231 last 0 00000100:00100000:2.0:1788625110.877726:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206101760:0@lo:400: 00000020:00000080:0.0:1788625110.877741:0:8868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7a241 00002000:00100000:0.0:1788625110.877756:0:8868:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff99885ee8d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788625110.877760:0:8868:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1788625110.877765:0:8868:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788625110.877773:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.877794:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206102272:0@lo:400: 00000100:00100000:2.0:1788625110.877817:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:0.0:1788625110.877833:0:8868:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788625110.878249:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206101504:0@lo:400: 00000100:00100000:2.0:1788625110.878297:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1788625110.878312:0:8868:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788625110.878335:0:8868:0:(import.c:65:import_set_state_nolock()) ffff99885ee89800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625110.878396:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206102016:0@lo:400: 00000100:00100000:2.0:1788625110.878423:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.878502:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788625110.878508:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206101632:0@lo:400: 00000100:00100000:0.0:1788625110.878587:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3634:x1875509206101248:12345-0@lo:8: Request processed in 902us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.878600:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788625110.878602:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.878619:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206102144:0@lo:400: 00000100:00100000:2.0:1788625110.878645:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.878669:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206101376 00000100:00100000:2.0:1788625110.878674:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206101376 00000100:00100000:2.0:1788625110.878699:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206101888 00000100:00100000:2.0:1788625110.878701:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206101888 00000020:01000000:1.0:1788625110.879018:0:10002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625110.879024:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625110.879026:0:10002:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788625110.879030:0:10002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625110.879034:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625110.879036:0:10002:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788625110.879038:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788625110.879040:0:10002:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788625110.879100:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206102272 00000100:00100000:2.0:1788625110.879105:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206102272 00000100:00100000:1.0:1788625110.879126:0:10002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10002:1875509206102400:0@lo:502: 00000100:00100000:1.0:1788625110.879174:0:10002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.879190:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206102016 00000100:00100000:2.0:1788625110.879196:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206102016 00000100:00100000:1.0:1788625110.879204:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206102400 00000100:00100000:1.0:1788625110.879209:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206102400 00000100:00100000:2.0:1788625110.879213:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206101632 00000100:00100000:2.0:1788625110.879217:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206101632 00000100:00100000:2.0:1788625110.879234:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206102144 00000100:00100000:2.0:1788625110.879238:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206102144 00000100:00100000:1.0:1788625110.879241:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788625110.879252:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:10002:x1875509206102400:12345-0@lo:502: 00000100:00100000:2.0:1788625110.879270:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788625110.879282:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206101376:12345-0@lo:400: 00000100:00100000:1.0:1788625110.879375:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:10002:x1875509206102400:12345-0@lo:502: Request processed in 126us (201us total) trans 0 rc 0/0 00010000:00080000:0.0:1788625110.879449:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c5ce00 x1875509206101248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625110.879462:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788625110.879469:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788625110.879476:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788625110.879481:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788625110.879484:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887cb8a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788625110.879924:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206101376:12345-0@lo:400: Request processed in 643us (2313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.879944:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788625110.879963:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788625110.879970:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206101888:12345-0@lo:400: 00000100:00100000:2.0:1788625110.880006:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206101888:12345-0@lo:400: Request processed in 36us (2326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.880011:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788625110.880022:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788625110.880028:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206102272:12345-0@lo:400: 00000100:00100000:2.0:1788625110.880055:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206102272:12345-0@lo:400: Request processed in 27us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.880061:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788625110.880072:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788625110.880078:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206102016:12345-0@lo:400: 00000100:00100000:1.0:1788625110.880148:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788625110.880193:0:10002:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c4da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625110.880209:0:10002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10002:1875509206102400:0@lo:502: 00000020:01000000:1.0:1788625110.880236:0:10002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625110.880242:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625110.880244:0:10002:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788625110.880247:0:10002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:2.0:1788625110.881225:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206102016:12345-0@lo:400: Request processed in 33us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.881236:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788625110.881271:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788625110.881282:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206101632:12345-0@lo:400: 00000004:00080000:0.0:1788625110.881482:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788625110.881493:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206101248:0@lo:8: 00000004:00080000:3.0:1788625110.881547:0:10003:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788625110.881574:0:10004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743835f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10004:1875509206102528:0@lo:700: 00000100:00100000:0.0:1788625110.881616:0:10004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788625110.881625:0:10003:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 231989106849ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788625110.881634:0:10003:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788625110.881647:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206102528 00000100:00100000:0.0:1788625110.881654:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206102528 00000100:00100000:2.0:1788625110.881714:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206101632:12345-0@lo:400: Request processed in 433us (3114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.881757:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625110.881764:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10004:x1875509206102528:12345-0@lo:700: 00000100:00100000:0.0:1788625110.881796:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8433:1875509206102656:0@lo:700: 00000100:00100000:2.0:1788625110.881797:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788625110.881820:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788625110.881830:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.881897:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866c640c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.881911:0:10004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da240 going to sleep for 11 seconds 00000100:00100000:3.0:1788625110.881943:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206102656 00000100:00100000:2.0:1788625110.882017:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206102144:12345-0@lo:400: 00000100:00100000:2.0:1788625110.882052:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206102144:12345-0@lo:400: Request processed in 225us (3406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.882058:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206102656 00000100:00100000:2.0:1788625110.882070:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788625110.882099:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206101760 00000100:00100000:2.0:1788625110.882103:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206101760 00000100:00100000:0.0:1788625110.882209:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625110.882219:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:8433:x1875509206102656:12345-0@lo:700: 00000100:00100000:2.0:1788625110.882412:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206101504 00000100:00100000:2.0:1788625110.882416:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206101504 00000100:00100000:2.0:1788625110.882429:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788625110.882435:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206101760:12345-0@lo:400: 00000100:00080000:3.0:1788625110.882591:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625110.882597:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625110.882600:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625110.882904:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206101760:12345-0@lo:400: Request processed in 468us (5130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.882912:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788625110.882927:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788625110.882934:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206101504:12345-0@lo:400: 00000100:00100000:2.0:1788625110.882965:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206101504:12345-0@lo:400: Request processed in 33us (4670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.882971:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788625110.883057:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742ea1880 x1875509206101632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625110.883242:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206101632:0@lo:400: 00010000:00080000:0.0:1788625110.883272:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742ea2d80 x1875509206102144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625110.883281:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206102144:0@lo:400: 00000100:00100000:0.0:1788625110.883292:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206101504:0@lo:400: 00010000:00080000:0.0:1788625110.883302:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742ea3800 x1875509206102016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625110.883309:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206102016:0@lo:400: 00000100:00100000:0.0:1788625110.883345:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206101760:0@lo:400: 00010000:00080000:0.0:1788625110.883414:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742ea1500 x1875509206102272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625110.883424:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206102272:0@lo:400: 00010000:00080000:0.0:1788625110.883439:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742ea0a80 x1875509206101376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625110.883445:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206101376:0@lo:400: 00010000:00080000:0.0:1788625110.883456:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742ea0e00 x1875509206101888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625110.883462:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206101888:0@lo:400: 00000020:01000000:3.0:1788625110.884609:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1788625110.884732:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788625110.884742:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c995400/0x2d2e3b3f34a7a21e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a225 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625110.884751:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887c995400/0x2d2e3b3f34a7a21e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a225 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625110.884758:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788625110.884760:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998852348000 from 39 10000000:01000000:3.0:1788625110.884762:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788625110.884920:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7a248 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625110.884929:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7a248 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625110.884941:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7a248 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625110.884965:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206102784:0@lo:101: 00000100:00100000:3.0:1788625110.885028:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625110.885167:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.885397:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206102784 00000100:00100000:0.0:1788625110.885406:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206102784 00000100:00100000:0.0:1788625110.885643:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788625110.885818:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206102784:12345-0@lo:101: 00010000:00010000:0.0:1788625110.886186:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625110.886204:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a24f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a248 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.886232:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a248 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.886243:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a248 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.886252:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994c00, rc 0) 00000100:00100000:0.0:1788625110.886331:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206102784:12345-0@lo:101: Request processed in 612us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.886339:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788625110.886722:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206102784:0@lo:101: 00010000:00010000:3.0:1788625110.886738:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7a248 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a24f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625110.886748:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7a248 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a24f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625110.887418:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206102912:0@lo:501: 00000100:00100000:3.0:1788625110.887459:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625110.887497:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206102912 00000100:00100000:3.0:1788625110.887502:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206102912 00000100:00100000:3.0:1788625110.887782:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788625110.887871:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206102912:12345-0@lo:501: 00000100:00100000:3.0:1788625110.887985:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206102912:12345-0@lo:501: Request processed in 194us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.887994:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788625110.888036:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625110.888053:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206102912:0@lo:501: 00000100:00100000:3.0:1788625110.888101:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206103040:0@lo:503: 00000100:00100000:3.0:1788625110.888136:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625110.888163:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625110.888199:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206103040 00000100:00100000:2.0:1788625110.888205:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206103040 00000100:00100000:2.0:1788625110.888239:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788625110.888249:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206103040:12345-0@lo:503: 00000100:00100000:2.0:1788625110.888379:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206103040:12345-0@lo:503: Request processed in 132us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.888387:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788625110.888406:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206103040:0@lo:503: 00000100:00100000:2.0:1788625110.888908:0:10006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10006:1875509206103168:0@lo:502: 00000004:00080000:3.0:1788625110.888953:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788625110.888956:0:10006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.888996:0:10006:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851ba3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788625110.888999:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206103168 00000100:00100000:3.0:1788625110.889004:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206103168 00000100:00100000:3.0:1788625110.889035:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788625110.889042:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:10006:x1875509206103168:12345-0@lo:502: 00000100:00100000:3.0:1788625110.889301:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:10006:x1875509206103168:12345-0@lo:502: Request processed in 258us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.889309:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788625110.890252:0:10006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10006:1875509206103168:0@lo:502: 00000100:00100000:2.0:1788625110.890376:0:10006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10006:1875509206103296:0@lo:502: 00000100:00100000:2.0:1788625110.890424:0:10006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.890722:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206103296 00000100:00100000:0.0:1788625110.890728:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206103296 00000100:00100000:0.0:1788625110.890764:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788625110.890772:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:10006:x1875509206103296:12345-0@lo:502: 00000100:00100000:0.0:1788625110.890864:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:10006:x1875509206103296:12345-0@lo:502: Request processed in 92us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.890905:0:10006:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851ba3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625110.890919:0:10006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10006:1875509206103296:0@lo:502: 00000040:00080000:2.0:1788625110.890944:0:10006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788625110.891511:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788625110.891634:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788625110.891644:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7a248 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a24f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625110.891655:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7a248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a24f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625110.891664:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788625110.891667:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998852348000 from 6 10000000:01000000:3.0:1788625110.891669:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788625110.891694:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625110.891701:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625110.891875:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625110.891893:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206103424:0@lo:101: 00000100:00100000:0.0:1788625110.891935:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788625110.891941:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625110.891987:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.891987:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206103424 00000100:00100000:0.0:1788625110.891994:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206103424 00000100:00100000:0.0:1788625110.892041:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788625110.892048:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206103424:12345-0@lo:101: 00010000:00010000:0.0:1788625110.892058:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625110.892071:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c995e00/0x2d2e3b3f34a7a25d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a256 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.892100:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c995e00/0x2d2e3b3f34a7a25d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a256 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.892110:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c995e00/0x2d2e3b3f34a7a25d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a256 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.892120:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995e00, rc 0) 00000100:00100000:0.0:1788625110.892163:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206103424:12345-0@lo:101: Request processed in 116us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.892169:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788625110.892297:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206103424:0@lo:101: 00010000:00010000:2.0:1788625110.892311:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a25d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.892321:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a25d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625110.892369:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206103552:0@lo:256: 00000100:00100000:2.0:1788625110.892410:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.892429:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851ba3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.892461:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206103552 00000100:00100000:0.0:1788625110.892466:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206103552 00000100:00100000:0.0:1788625110.892500:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788625110.892507:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206103552:12345-0@lo:256: 20000000:01000000:0.0:1788625110.892547:0:6503:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788625110.892566:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788625110.892569:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788625110.892668:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206103552:12345-0@lo:256: Request processed in 160us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.892676:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788625110.892685:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206103552:0@lo:256: 10000000:01000000:2.0:1788625110.892735:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788625110.892742:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a25d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.892749:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a25d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625110.892756:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788625110.892758:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788625110.892760:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788625110.892776:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.892788:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.892796:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625110.892808:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206103680:0@lo:101: 00000100:00100000:2.0:1788625110.892832:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.892867:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851ba3c00 going to sleep for 11 seconds 40000000:02000000:2.0:1788625110.892975:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1788625110.893329:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206103680 00000100:00100000:0.0:1788625110.893335:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206103680 00000100:00100000:0.0:1788625110.893371:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788625110.893379:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206103680:12345-0@lo:101: 00010000:00010000:0.0:1788625110.893388:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625110.893400:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c995a00/0x2d2e3b3f34a7a26b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a264 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.893431:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c995a00/0x2d2e3b3f34a7a26b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a264 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.893442:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c995a00/0x2d2e3b3f34a7a26b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a264 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625110.893450:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995a00, rc 0) 00000100:00100000:0.0:1788625110.893486:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206103680:12345-0@lo:101: Request processed in 108us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.893492:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788625110.894674:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206103680:0@lo:101: 00010000:00010000:3.0:1788625110.894696:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a26b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625110.894897:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a26b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625110.894959:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206103808:0@lo:501: 00000100:00100000:3.0:1788625110.895011:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625110.895054:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.895620:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206103808 00000100:00100000:0.0:1788625110.895628:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206103808 00000100:00100000:0.0:1788625110.895675:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788625110.895684:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206103808:12345-0@lo:501: 00000100:00100000:0.0:1788625110.896307:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206103808:12345-0@lo:501: Request processed in 623us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.896324:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788625110.896363:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206103808:0@lo:501: 00000100:00100000:3.0:1788625110.896400:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206103936:0@lo:503: 00000100:00100000:3.0:1788625110.896462:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625110.896500:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.896502:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206103936 00000100:00100000:0.0:1788625110.896507:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206103936 00000100:00100000:0.0:1788625110.896553:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788625110.896560:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206103936:12345-0@lo:503: 00000100:00100000:0.0:1788625110.896652:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206103936:12345-0@lo:503: Request processed in 91us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.896658:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788625110.896962:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206103936:0@lo:503: 00000100:00100000:0.0:1788625110.897926:0:10007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743836680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10007:1875509206104064:0@lo:502: 00000100:00100000:0.0:1788625110.897979:0:10007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.898053:0:10007:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742dd7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625110.898160:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206104064 00000100:00100000:1.0:1788625110.898167:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206104064 00000100:00100000:1.0:1788625110.898236:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788625110.898245:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:10007:x1875509206104064:12345-0@lo:502: 00000100:00100000:1.0:1788625110.898373:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:10007:x1875509206104064:12345-0@lo:502: Request processed in 129us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625110.898381:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788625110.898460:0:10007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743836680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10007:1875509206104064:0@lo:502: 00000020:01000000:0.0:1788625110.898484:0:10007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788625110.898492:0:10007:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788625110.898499:0:10007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625110.898501:0:10007:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788625110.898507:0:10007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788625110.898510:0:10007:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:01000000:0.0:1788625110.898570:0:10007:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788625110.898573:0:10007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625110.898587:0:10007:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99887cb199c0) 00000020:00000080:0.0:1788625110.898623:0:10007:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1788625110.898629:0:10007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788625110.898722:0:10007:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788625110.898727:0:10007:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788625110.898734:0:10007:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7a279 00010000:00080000:0.0:1788625110.898781:0:10007:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99885ee88000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.114@tcp at head 00010000:00010000:0.0:1788625110.899036:0:10007:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1788625110.899458:0:10007:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788625110.899470:0:10007:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788625110.899773:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:8433:x1875509206102656:12345-0@lo:700: Request processed in 17544us (17931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.899783:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788625110.899826:0:8433:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743834000 x1875509206102656/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788625126 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625110.899841:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8433:1875509206102656:0@lo:700: 40000000:02000000:3.0:1788625110.899854:0:8433:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:1.0:1788625110.900883:0:10007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625110.901279:0:10007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625110.901418:0:10007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788625110.901767:0:10007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788625110.902420:0:10008:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788625110.902425:0:10008:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788625110.905223:0:10007:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788625110.905242:0:10007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788625110.905814:0:10007:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788625110.905848:0:10007:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7a280 00000100:00080000:1.0:1788625110.905861:0:10007:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788625110.905869:0:10007:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99885ee88000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625110.905927:0:10007:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998742c5df80 x1875509206104192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788625110.905950:0:10007:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788625110.906013:0:10007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625110.906018:0:10007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625110.906020:0:10007:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788625110.906023:0:10007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625110.906027:0:10007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625110.906028:0:10007:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788625110.906031:0:10007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788625110.906033:0:10007:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788625110.906059:0:10007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10007:1875509206104320:0@lo:502: 00000100:00100000:1.0:1788625110.906159:0:10007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625110.906205:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206104320 00000100:00100000:1.0:1788625110.906211:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206104320 00000100:00100000:1.0:1788625110.906267:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788625110.906388:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:10007:x1875509206104320:12345-0@lo:502: 00000100:00100000:2.0:1788625110.906536:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206104192:0@lo:8: 00000100:00100000:2.0:1788625110.906581:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625110.906877:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:10007:x1875509206104320:12345-0@lo:502: Request processed in 600us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625110.906886:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788625110.906930:0:10007:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c4d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625110.906954:0:10007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10007:1875509206104320:0@lo:502: 00000020:01000000:1.0:1788625110.906983:0:10007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625110.906988:0:10007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625110.906990:0:10007:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788625110.906994:0:10007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1788625110.907159:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1788625110.907184:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788625110.907195:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a26b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.907206:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a26b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625110.907215:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788625110.907218:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99885ecd99c0 from 1 10000000:01000000:2.0:1788625110.907220:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788625110.907245:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.907266:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.907405:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625110.907489:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206104448:0@lo:101: 00000100:00100000:2.0:1788625110.907552:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.907574:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851ba3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788625110.907679:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206104192 00000100:00100000:3.0:1788625110.907686:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206104192 00000100:00100000:3.0:1788625110.907932:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788625110.907940:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875509206104192:12345-0@lo:8: 00000100:00100000:2.0:1788625110.907978:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206104960:0@lo:400: 00010000:00080000:3.0:1788625110.907979:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:3.0:1788625110.908017:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7a28e 00000100:00100000:2.0:1788625110.908023:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:3.0:1788625110.908034:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff998743527800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788625110.908041:0:8425:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788625110.908044:0:8425:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788625110.908045:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206105472:0@lo:400: 00000100:00100000:2.0:1788625110.908067:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.908085:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788625110.908091:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206104576:0@lo:400: 00000100:00100000:2.0:1788625110.908112:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.908128:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206105088:0@lo:400: 00000100:00100000:2.0:1788625110.908146:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.908161:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206105600:0@lo:400: 00000100:00100000:2.0:1788625110.908178:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1788625110.908188:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1788625110.908206:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206104832:0@lo:400: 00000100:00080000:3.0:1788625110.908220:0:8425:0:(import.c:65:import_set_state_nolock()) ffff998743523000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625110.908232:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625110.908289:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1875509206104192:12345-0@lo:8: Request processed in 349us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.908296:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788625110.908309:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206105472 00000100:00100000:3.0:1788625110.908312:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206105472 00000100:00100000:3.0:1788625110.908829:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625110.908837:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206105472:12345-0@lo:400: 00000100:00100000:3.0:1788625110.908876:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206105472:12345-0@lo:400: Request processed in 41us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.908882:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625110.908904:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206104576 00000100:00100000:3.0:1788625110.908907:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206104576 00000100:00100000:3.0:1788625110.908921:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206105088 00000100:00100000:3.0:1788625110.908923:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206105088 00000100:00100000:3.0:1788625110.908931:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206105600 00000100:00100000:3.0:1788625110.908933:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206105600 00000100:00100000:3.0:1788625110.908942:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206104832 00000100:00100000:3.0:1788625110.908944:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206104832 00000100:00100000:3.0:1788625110.908953:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788625110.908959:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206104576:12345-0@lo:400: 00000100:00100000:3.0:1788625110.908987:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206104576:12345-0@lo:400: Request processed in 28us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.908993:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788625110.909004:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788625110.909009:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206105088:12345-0@lo:400: 00000100:00100000:3.0:1788625110.909035:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206105088:12345-0@lo:400: Request processed in 26us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.909053:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788625110.909072:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788625110.909701:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206105600:12345-0@lo:400: 00000100:00100000:3.0:1788625110.909957:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206105600:12345-0@lo:400: Request processed in 263us (1778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.909964:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788625110.909983:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788625110.909990:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206104832:12345-0@lo:400: 00000100:00100000:3.0:1788625110.910020:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206104832:12345-0@lo:400: Request processed in 30us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.910026:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788625110.910047:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206104448 00000100:00100000:1.0:1788625110.910054:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206104448 00000100:00100000:1.0:1788625110.910095:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788625110.910113:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206104448:12345-0@lo:101: 00010000:00010000:1.0:1788625110.910127:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625110.910144:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998859be8200/0x2d2e3b3f34a7a295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a287 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625110.910170:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998859be8200/0x2d2e3b3f34a7a295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a287 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625110.910181:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998859be8200/0x2d2e3b3f34a7a295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a287 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625110.910191:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be8200, rc 0) 00000100:00100000:3.0:1788625110.910229:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206104960 00000100:00100000:1.0:1788625110.910232:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206104448:12345-0@lo:101: Request processed in 120us (2678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.910235:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206104960 00000100:00100000:1.0:1788625110.910242:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788625110.910281:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788625110.910288:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206104960:12345-0@lo:400: 00000100:00100000:3.0:1788625110.910335:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206104960:12345-0@lo:400: Request processed in 48us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.910342:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788625110.910395:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c5df80 x1875509206104192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625110.910407:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788625110.910416:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788625110.910423:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788625110.910427:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788625110.910430:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99885ee88000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788625110.910445:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788625110.910451:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206104192:0@lo:8: 00010000:00080000:3.0:1788625110.910496:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4dd880 x1875509206104576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625110.910513:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206104576:0@lo:400: 00000100:00100000:0.0:1788625110.910554:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206104704:0@lo:400: 00010000:00080000:3.0:1788625110.910585:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4dd500 x1875509206105088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625110.910596:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206105088:0@lo:400: 00000100:00100000:0.0:1788625110.910597:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788625110.910624:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743833800 x1875509206105600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625110.910628:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206105216:0@lo:400: 00000100:00100000:3.0:1788625110.910642:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206105600:0@lo:400: 00000004:00080000:1.0:1788625110.910868:0:10008:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788625110.910938:0:10008:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 232018420074ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788625110.910945:0:10008:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788625110.911005:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206104960:0@lo:400: 00010000:00080000:3.0:1788625110.911024:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743830e00 x1875509206105472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625110.911033:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206105472:0@lo:400: 00000100:00100000:3.0:1788625110.911092:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206104704 00000100:00100000:3.0:1788625110.911096:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206104704 00000100:00100000:3.0:1788625110.911123:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788625110.911131:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206104704:12345-0@lo:400: 00000100:00100000:3.0:1788625110.911174:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206104704:12345-0@lo:400: Request processed in 44us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.911180:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788625110.911776:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206105344:0@lo:400: 00000100:00100000:2.0:1788625110.911822:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.911858:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206105856:0@lo:400: 00000100:00100000:2.0:1788625110.911883:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788625110.911919:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4dd180 x1875509206104832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625110.911938:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206104832:0@lo:400: 00000100:00100000:3.0:1788625110.912104:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206105344 00000100:00100000:3.0:1788625110.912109:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206105344 00000100:00100000:3.0:1788625110.912141:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206105856 00000100:00100000:3.0:1788625110.912145:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206105856 00000100:00100000:3.0:1788625110.912165:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788625110.912172:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206105344:12345-0@lo:400: 00000100:00100000:3.0:1788625110.912227:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206105344:12345-0@lo:400: Request processed in 56us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.912234:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788625110.912248:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625110.912267:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3638:x1875509206105856:12345-0@lo:400: 00000100:00100000:2.0:1788625110.913396:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206104448:0@lo:101: 00010000:00010000:2.0:1788625110.913424:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a295 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.913439:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a295 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625110.914318:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3638:x1875509206105856:12345-0@lo:400: Request processed in 2061us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625110.914329:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788625110.914380:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844937480 x1875509206105344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625110.914393:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206105344:0@lo:400: 00010000:00080000:3.0:1788625110.914410:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743831500 x1875509206105856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625110.914417:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206105856:0@lo:400: 00000100:00100000:0.0:1788625110.914676:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.914715:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206105728:0@lo:400: 00000100:00100000:0.0:1788625110.914749:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.914789:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206104704:0@lo:400: 00000100:00100000:0.0:1788625110.914830:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206105216 00000100:00100000:0.0:1788625110.914847:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206105216 00000100:00100000:0.0:1788625110.914887:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206105728 00000100:00100000:0.0:1788625110.914890:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206105728 00000100:00100000:0.0:1788625110.914910:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788625110.914919:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206105216:12345-0@lo:400: 00000004:00080000:1.0:1788625110.914921:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788625110.915101:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206105216:12345-0@lo:400: Request processed in 183us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.915108:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788625110.915122:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788625110.915128:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206105728:12345-0@lo:400: 00000100:00100000:0.0:1788625110.915157:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206105728:12345-0@lo:400: Request processed in 29us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.915163:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788625110.915759:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844934e00 x1875509206105216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625110.915774:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206105216:0@lo:400: 00010000:00080000:1.0:1788625110.915790:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743832d80 x1875509206105728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625110.915798:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206105728:0@lo:400: 00000100:00100000:2.0:1788625110.915878:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206105984:0@lo:501: 00000100:00100000:2.0:1788625110.915918:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.915953:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.916040:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206105984 00000001:00100000:3.0:1788625110.916055:0:9503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788625110.916062:0:9503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788625110.916103:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206105984 00000100:00100000:0.0:1788625110.916184:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788625110.916194:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206105984:12345-0@lo:501: 00000100:00100000:2.0:1788625110.916240:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10004:x1875509206102528:12345-0@lo:700: Request processed in 34473us (34621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.916252:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625110.916290:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206105984:12345-0@lo:501: Request processed in 96us (370us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625110.916298:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206105984:0@lo:501: 00000100:00100000:0.0:1788625110.916300:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 10000000:01000000:2.0:1788625110.916764:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788625110.916775:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a287 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a295 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625110.916787:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a295 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788625110.917858:0:10004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743835f80 x1875509206102528/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788625126 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625110.917874:0:10004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743835f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10004:1875509206102528:0@lo:700: 00000004:00080000:3.0:1788625110.920759:0:10009:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788625110.920783:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625110.920794:0:10009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743686d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10009:1875509206106240:0@lo:7: 00000100:00100000:1.0:1788625110.920803:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206106112:0@lo:13: 00000100:00100000:3.0:1788625110.920869:0:10009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625110.920876:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625110.920909:0:10009:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625110.921139:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206106112 00000100:00100000:1.0:1788625110.921146:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206106112 00000100:00100000:1.0:1788625110.921267:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625110.921277:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206106112:12345-0@lo:13: 00002000:00000024:1.0:1788625110.921306:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1788625110.921369:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206106112:12345-0@lo:13: Request processed in 94us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625110.921376:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625110.921399:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206106240 00000100:00100000:1.0:1788625110.921403:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206106240 00000100:00100000:1.0:1788625110.921426:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625110.921433:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10009:x1875509206106240:12345-0@lo:7: 00000100:00080000:3.0:1788625110.921821:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788625110.922295:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743687800 x1875509206106112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625110.922330:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206106112:0@lo:13: 00000100:00100000:2.0:1788625110.927137:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:3.0:1788625110.927161:0:10004:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788625110.927190:0:10004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743685180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10004:1875509206106496:0@lo:7: 00000100:00100000:3.0:1788625110.927271:0:10004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625110.927344:0:10004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c2300 going to sleep for 11 seconds 00002000:00080000:1.0:1788625110.927428:0:8424:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788625110.927434:0:8424:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788625110.927577:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206106496 00000100:00100000:0.0:1788625110.927585:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206106496 00000100:00100000:0.0:1788625110.927632:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625110.927641:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10004:x1875509206106496:12345-0@lo:7: 00000100:00100000:2.0:1788625110.927899:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206106368:0@lo:13: 00000100:00100000:2.0:1788625110.927938:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625110.927972:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206106368 00000100:00100000:2.0:1788625110.927989:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206106368 00000100:00100000:2.0:1788625110.928026:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788625110.928034:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1875509206106368:12345-0@lo:13: 00002000:00000024:2.0:1788625110.928049:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788625110.928092:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1875509206106368:12345-0@lo:13: Request processed in 59us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.928100:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788625110.928241:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743686a00 x1875509206106368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625110.928272:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206106368:0@lo:13: 00000100:00100000:1.0:1788625110.930567:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10009:x1875509206106240:12345-0@lo:7: Request processed in 9126us (9690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625110.930580:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788625110.930703:0:10009:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743686d80 x1875509206106240/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788625126 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625110.930717:0:10009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743686d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10009:1875509206106240:0@lo:7: 00000004:00080000:3.0:1788625110.930732:0:10009:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788625110.930770:0:10009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743686d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10009:1875509206106624:0@lo:5: 00000100:00100000:3.0:1788625110.930817:0:10009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625110.930886:0:10009:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c26c0 going to sleep for 11 seconds 00002000:00080000:0.0:1788625110.931418:0:8423:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788625110.931424:0:8423:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788625110.931475:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10004:x1875509206106496:12345-0@lo:7: Request processed in 3834us (4203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.931482:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788625110.931513:0:10004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743685180 x1875509206106496/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788625126 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625110.931541:0:10004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743685180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10004:1875509206106496:0@lo:7: 00000004:00080000:0.0:1788625110.931550:0:10004:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788625110.931572:0:10004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743835f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10004:1875509206106752:0@lo:5: 00000100:00100000:0.0:1788625110.931595:0:10004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625110.936377:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206106624 00000100:00100000:1.0:1788625110.936397:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206106624 00000100:00100000:0.0:1788625110.936432:0:10004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625110.936457:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206106752 00000100:00100000:0.0:1788625110.936461:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206106752 00000100:00100000:0.0:1788625110.936511:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625110.936537:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10004:x1875509206106752:12345-0@lo:5: 00002000:00080000:0.0:1788625110.936570:0:8423:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788625110.936632:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10004:x1875509206106752:12345-0@lo:5: Request processed in 97us (5034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.936639:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788625110.936679:0:10004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743835f80 x1875509206106752/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625126 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625110.936691:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788625110.936693:0:10004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743835f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10004:1875509206106752:0@lo:5: 00000100:00100000:1.0:1788625110.936697:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10009:x1875509206106624:12345-0@lo:5: 00000004:00080000:0.0:1788625110.936705:0:10004:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00002000:00080000:1.0:1788625110.936710:0:8425:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788625110.936713:0:8425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788625110.936746:0:10004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743835f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10004:1875509206106880:0@lo:5: 00000100:00100000:1.0:1788625110.937400:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10009:x1875509206106624:12345-0@lo:5: Request processed in 701us (6580us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788625110.937408:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788625110.937679:0:10009:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743686d80 x1875509206106624/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625126 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625110.937703:0:10009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743686d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10009:1875509206106624:0@lo:5: 00000004:00080000:1.0:1788625110.937712:0:10009:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788625110.937942:0:10009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10009:1875509206107008:0@lo:700: 00000100:00100000:1.0:1788625110.938182:0:10009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625110.938208:0:10009:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b7a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625110.938211:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206107008 00000100:00100000:3.0:1788625110.938216:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206107008 00000100:00100000:3.0:1788625110.938250:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788625110.938269:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10009:x1875509206107008:12345-0@lo:700: 00000100:00100000:0.0:1788625110.938432:0:10004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.938464:0:10004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625110.939563:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206106880 00000100:00100000:2.0:1788625110.940063:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206106880 00000100:00100000:2.0:1788625110.942202:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788625110.942215:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10004:x1875509206106880:12345-0@lo:5: 00002000:00080000:2.0:1788625110.942275:0:8868:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000001:00080000:3.0:1788625110.943970:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1788625110.944182:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10009:x1875509206107008:12345-0@lo:700: Request processed in 5910us (5996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625110.944194:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788625110.944274:0:10009:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c5df80 x1875509206107008/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788625126 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625110.944285:0:10009:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788625110.944299:0:10009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10009:1875509206107008:0@lo:700: 00000100:00100000:2.0:1788625110.946220:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:10004:x1875509206106880:12345-0@lo:5: Request processed in 4003us (7782us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788625110.946231:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788625110.946573:0:10004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743835f80 x1875509206106880/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625126 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625110.946591:0:10004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743835f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10004:1875509206106880:0@lo:5: 00000004:00080000:0.0:1788625110.946609:0:10004:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788625110.946650:0:10004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10004:1875509206107136:0@lo:900: 00000100:00100000:0.0:1788625110.946692:0:10004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625110.946736:0:10004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625110.946811:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206107136 00000100:00100000:2.0:1788625110.946818:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206107136 00000100:00100000:2.0:1788625110.946856:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625110.946864:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10004:x1875509206107136:12345-0@lo:900: 00000100:00100000:2.0:1788625110.947211:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10004:x1875509206107136:12345-0@lo:900: Request processed in 346us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625110.947219:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788625110.948030:0:10004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742ea0a80 x1875509206107136/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788625126 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625110.948044:0:10004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10004:1875509206107136:0@lo:900: 00000004:02000040:3.0:1788625110.949625:0:10009:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1788625110.953413:0:10009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743686d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10009:1875509206107264:0@lo:5: 00000100:00100000:3.0:1788625110.953484:0:10009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625110.953537:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206107264 00000100:00100000:1.0:1788625110.953545:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206107264 00000100:00100000:1.0:1788625110.953644:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788625110.953655:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10009:x1875509206107264:12345-0@lo:5: 00000100:00100000:3.0:1788625110.953776:0:10009:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c2600 going to sleep for 11 seconds 00002000:00080000:1.0:1788625110.968820:0:8424:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788625110.968841:0:8424:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1788625110.972468:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10009:x1875509206107264:12345-0@lo:5: Request processed in 18808us (18975us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788625110.972483:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788625110.973871:0:10009:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743686d80 x1875509206107264/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625126 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625110.973902:0:10009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743686d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10009:1875509206107264:0@lo:5: 00000004:00080000:2.0:1788625110.973917:0:10009:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:1.0:1788625111.126614:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788625111.148191:0:10029:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788625111.148737:0:10029:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788625111.315805:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206107392:0@lo:41: 00000100:00100000:2.0:1788625111.315881:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625111.316002:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206107392 00000100:00100000:1.0:1788625111.316010:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206107392 00000100:00100000:1.0:1788625111.316067:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788625111.316076:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206107392:12345-0@lo:41: 00000004:00000024:1.0:1788625111.316113:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788625111.316163:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206107392:12345-0@lo:41: Request processed in 88us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625111.316170:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788625111.316214:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206107392:0@lo:41: 00000020:00000004:3.0:1788625112.049387:0:10077:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625112.049396:0:10077:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788625112.140666:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625112.640635:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625112.641000:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185085568 00000100:00100000:1.0:1788625112.641015:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185085568 00000100:00100000:1.0:1788625112.641140:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 181 00000100:00100000:1.0:1788625112.641152:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2390:x1875509185085568:12345-192.168.204.14@tcp:250: 00010000:00080000:1.0:1788625112.641198:0:6503:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc@192.168.204.14@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1788625112.641257:0:6503:0:(genops.c:1385:class_connect()) connect: client e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc, cookie 0x2d2e3b3f34a7a29c 00000100:00080000:1.0:1788625112.641453:0:6503:0:(import.c:65:import_set_state_nolock()) ffff99885ee8d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625112.641581:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+5:2390:x1875509185085568:12345-192.168.204.14@tcp:250: Request processed in 429us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625112.641591:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 181 00000100:00100000:2.0:1788625112.646902:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625112.646995:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185085696 00000100:00100000:0.0:1788625112.647009:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185085696 00000100:00100000:0.0:1788625112.647093:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 182 00000100:00100000:0.0:1788625112.647106:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+5:6150:x1875509185085696:12345-192.168.204.14@tcp:101: 00010000:00010000:0.0:1788625112.647128:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625112.647152:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c994800/0x2d2e3b3f34a7a2a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3df1e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625112.647199:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c994800/0x2d2e3b3f34a7a2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df1e expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625112.647248:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c994800/0x2d2e3b3f34a7a2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df1e expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625112.647260:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994800, rc 0) 00000100:00100000:0.0:1788625112.647341:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+6:6150:x1875509185085696:12345-192.168.204.14@tcp:101: Request processed in 237us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625112.647349:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 182 00000100:00100000:2.0:1788625112.650513:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625112.650719:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185085824 00000100:00100000:1.0:1788625112.650734:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185085824 00000100:00100000:1.0:1788625112.650801:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 183 00000100:00100000:1.0:1788625112.650813:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+6:6150:x1875509185085824:12345-192.168.204.14@tcp:501: 00000100:00100000:1.0:1788625112.650975:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+6:6150:x1875509185085824:12345-192.168.204.14@tcp:501: Request processed in 164us (476us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788625112.650985:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 183 00000100:00100000:2.0:1788625112.656357:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625112.656819:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185085952 00000100:00100000:1.0:1788625112.656833:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185085952 00000100:00100000:1.0:1788625112.656901:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 184 00000100:00100000:1.0:1788625112.656922:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+6:6150:x1875509185085952:12345-192.168.204.14@tcp:101: 00010000:00010000:1.0:1788625112.656940:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625112.656960:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a2aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3df25 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625112.656992:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df25 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625112.657018:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df25 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625112.657028:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be9c00, rc 0) 00000100:00100000:1.0:1788625112.657139:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+7:6150:x1875509185085952:12345-192.168.204.14@tcp:101: Request processed in 228us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625112.657147:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 184 00000100:00100000:2.0:1788625112.665254:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625112.668713:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185086080 00000100:00100000:0.0:1788625112.668731:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185086080 00000100:00100000:2.0:1788625112.669123:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 185 00000100:00100000:2.0:1788625112.669136:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+7:6150:x1875509185086080:12345-192.168.204.14@tcp:501: 00000100:00100000:2.0:1788625112.669335:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+8:6150:x1875509185086080:12345-192.168.204.14@tcp:501: Request processed in 201us (4092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625112.669344:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 185 00000100:00100000:3.0:1788625112.673644:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625112.678765:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185086208 00000100:00100000:1.0:1788625112.678782:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185086208 00000100:00100000:1.0:1788625112.678846:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 186 00000100:00100000:1.0:1788625112.678857:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+8:6150:x1875509185086208:12345-192.168.204.14@tcp:503: 00000100:00100000:1.0:1788625112.679038:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+8:6150:x1875509185086208:12345-192.168.204.14@tcp:503: Request processed in 182us (5403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625112.679046:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 186 00000100:00100000:3.0:1788625112.683479:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625112.683540:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185086336 00000100:00100000:3.0:1788625112.683549:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185086336 00000100:00100000:3.0:1788625112.683594:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 187 00000100:00100000:3.0:1788625112.683604:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+8:6168:x1875509185086336:12345-192.168.204.14@tcp:502: 00000100:00100000:3.0:1788625112.683753:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+8:6168:x1875509185086336:12345-192.168.204.14@tcp:502: Request processed in 149us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625112.683761:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 187 00000100:00100000:3.0:1788625112.726118:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625112.726271:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185086464 00000100:00100000:1.0:1788625112.726293:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185086464 00000100:00100000:1.0:1788625112.726358:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 188 00000100:00100000:1.0:1788625112.726368:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+8:6168:x1875509185086464:12345-192.168.204.14@tcp:502: 00000100:00100000:1.0:1788625112.726583:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+8:6168:x1875509185086464:12345-192.168.204.14@tcp:502: Request processed in 215us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625112.726592:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 188 00000100:00100000:1.0:1788625112.742308:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625112.742426:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185086592 00000100:00100000:0.0:1788625112.742437:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185086592 00000100:00100000:0.0:1788625112.742505:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 189 00000100:00100000:0.0:1788625112.742557:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+8:6150:x1875509185086592:12345-192.168.204.14@tcp:101: 00010000:00010000:0.0:1788625112.742581:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625112.742601:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c994000/0x2d2e3b3f34a7a2b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3df56 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625112.742646:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c994000/0x2d2e3b3f34a7a2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df56 expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625112.742659:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c994000/0x2d2e3b3f34a7a2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df56 expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625112.742669:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994000, rc 0) 00000100:00100000:0.0:1788625112.742743:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:6150:x1875509185086592:12345-192.168.204.14@tcp:101: Request processed in 229us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625112.742749:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 189 00000100:00100000:3.0:1788625112.766088:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625112.766276:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185086720 00000100:00100000:2.0:1788625112.766287:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185086720 00000100:00100000:2.0:1788625112.766359:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 190 00000100:00100000:2.0:1788625112.766370:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:6150:x1875509185086720:12345-192.168.204.14@tcp:256: 20000000:01000000:2.0:1788625112.766406:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788625112.766432:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788625112.766436:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788625112.766439:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788625112.766442:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788625112.766445:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788625112.770046:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:6150:x1875509185086720:12345-192.168.204.14@tcp:256: Request processed in 3667us (3962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625112.770073:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 190 00000100:00100000:1.0:1788625112.776992:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625112.777141:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185086848 00000100:00100000:3.0:1788625112.777152:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185086848 00000100:00100000:3.0:1788625112.777211:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 191 00000100:00100000:3.0:1788625112.777233:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:6150:x1875509185086848:12345-192.168.204.14@tcp:101: 00010000:00010000:3.0:1788625112.777250:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625112.777272:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b683a00/0x2d2e3b3f34a7a2b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3df5d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625112.777310:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b683a00/0x2d2e3b3f34a7a2b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df5d expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625112.777323:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b683a00/0x2d2e3b3f34a7a2b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df5d expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625112.777333:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683a00, rc 0) 00000100:00100000:3.0:1788625112.777391:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6150:x1875509185086848:12345-192.168.204.14@tcp:101: Request processed in 170us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625112.777413:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 191 00000100:00100000:3.0:1788625112.781379:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625112.781472:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185086976 00000100:00100000:2.0:1788625112.781490:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185086976 00000100:00100000:2.0:1788625112.781753:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 192 00000100:00100000:2.0:1788625112.781764:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6150:x1875509185086976:12345-192.168.204.14@tcp:501: 00000100:00100000:2.0:1788625112.781937:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6150:x1875509185086976:12345-192.168.204.14@tcp:501: Request processed in 175us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625112.782410:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 192 00000100:00100000:2.0:1788625112.786933:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625112.787093:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185087104 00000100:00100000:0.0:1788625112.787104:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185087104 00000100:00100000:0.0:1788625112.787164:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 193 00000100:00100000:0.0:1788625112.787173:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6150:x1875509185087104:12345-192.168.204.14@tcp:503: 00000100:00100000:0.0:1788625112.787353:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6150:x1875509185087104:12345-192.168.204.14@tcp:503: Request processed in 180us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625112.787361:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 193 00000100:00100000:1.0:1788625112.793965:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625112.794140:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185087232 00000100:00100000:3.0:1788625112.794151:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185087232 00000100:00100000:3.0:1788625112.794207:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 194 00000100:00100000:3.0:1788625112.794227:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6173:x1875509185087232:12345-192.168.204.14@tcp:502: 00000100:00100000:3.0:1788625112.794390:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6173:x1875509185087232:12345-192.168.204.14@tcp:502: Request processed in 175us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625112.794398:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 194 00000100:00100000:3.0:1788625112.797627:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625112.797727:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185087360 00000100:00100000:2.0:1788625112.797736:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185087360 00000100:00100000:2.0:1788625112.797792:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 195 00000100:00100000:2.0:1788625112.797804:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6173:x1875509185087360:12345-192.168.204.14@tcp:502: 00000100:00100000:2.0:1788625112.798115:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6173:x1875509185087360:12345-192.168.204.14@tcp:502: Request processed in 312us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625112.798124:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 195 00000100:00100000:2.0:1788625112.803757:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625112.803802:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625112.803922:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185087488 00000100:00100000:3.0:1788625112.803932:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185087488 00000100:00100000:3.0:1788625112.803981:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185087744 00000100:00100000:3.0:1788625112.803984:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185087744 00000100:00100000:3.0:1788625112.804015:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:3.0:1788625112.804023:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1875509185087488:12345-192.168.204.14@tcp:38: 00010000:00080000:3.0:1788625112.804052:0:9824:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:3.0:1788625112.804105:0:9824:0:(genops.c:1385:class_connect()) connect: client 1338b3dc-3f02-4b26-a9aa-7a14f6033224, cookie 0x2d2e3b3f34a7a2bf 00000004:00100000:3.0:1788625112.804130:0:9824:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788625112.804371:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00100000:2.0:1788625112.804377:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1875509185087744:12345-192.168.204.14@tcp:38: 00010000:00080000:2.0:1788625112.804393:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:2.0:1788625112.804424:0:6511:0:(genops.c:1385:class_connect()) connect: client 1338b3dc-3f02-4b26-a9aa-7a14f6033224, cookie 0x2d2e3b3f34a7a2c6 00000004:00100000:2.0:1788625112.804436:0:6511:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788625112.804641:0:6511:0:(import.c:65:import_set_state_nolock()) ffff99887b611000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625112.804711:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2390:x1875509185087744:12345-192.168.204.14@tcp:38: Request processed in 332us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625112.804726:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00080000:3.0:1788625112.805234:0:9824:0:(import.c:65:import_set_state_nolock()) ffff998743521800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625112.805277:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2390:x1875509185087488:12345-192.168.204.14@tcp:38: Request processed in 1254us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625112.805622:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 7 00010000:00010000:1.0:1788625113.165314:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625113.816578:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625113.816620:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625113.816707:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625113.821285:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185087616 00000100:00100000:1.0:1788625113.821305:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185087616 00000100:00100000:3.0:1788625113.821333:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185087872 00000100:00100000:3.0:1788625113.821342:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185087872 00000100:00100000:3.0:1788625113.821413:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185088000 00000100:00100000:3.0:1788625113.821432:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185088000 00000100:00100000:3.0:1788625113.821460:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:3.0:1788625113.821470:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:0:x1875509185087872:12345-192.168.204.14@tcp:41: 00000004:00000024:3.0:1788625113.821545:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788625113.821631:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:0:x1875509185087872:12345-192.168.204.14@tcp:41: Request processed in 162us (5009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625113.821639:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:3.0:1788625113.821659:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:3.0:1788625113.821666:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:6150:x1875509185088000:12345-192.168.204.14@tcp:41: 00000004:00000024:3.0:1788625113.821703:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788625113.821729:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:6150:x1875509185088000:12345-192.168.204.14@tcp:41: Request processed in 64us (5023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625113.821736:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00080000:0.0:1788625113.821875:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788625113.821879:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625113.825382:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00100000:1.0:1788625113.825404:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:0:x1875509185087616:12345-192.168.204.14@tcp:41: 00000004:00000024:1.0:1788625113.825441:0:9824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788625113.825539:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:0:x1875509185087616:12345-192.168.204.14@tcp:41: Request processed in 143us (8970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625113.825548:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00100000:2.0:1788625113.828382:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625113.834584:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185088128 00000100:00100000:0.0:1788625113.834603:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185088128 00000100:00100000:0.0:1788625113.834678:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00100000:0.0:1788625113.834689:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:6150:x1875509185088128:12345-192.168.204.14@tcp:40: 00000100:00100000:0.0:1788625113.834835:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:6150:x1875509185088128:12345-192.168.204.14@tcp:40: Request processed in 147us (6462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625113.834843:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00100000:0.0:1788625113.839798:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625113.839845:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625113.840076:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185088256 00000100:00100000:2.0:1788625113.840085:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185088256 00000100:00100000:2.0:1788625113.840131:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185088384 00000100:00100000:2.0:1788625113.840134:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185088384 00000100:00100000:2.0:1788625113.840161:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:2.0:1788625113.840169:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1875509185088256:12345-192.168.204.14@tcp:8: 00010000:00080000:2.0:1788625113.840214:0:8423:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:2.0:1788625113.840279:0:8423:0:(genops.c:1385:class_connect()) connect: client 1338b3dc-3f02-4b26-a9aa-7a14f6033224, cookie 0x2d2e3b3f34a7a2cd 00002000:00100000:2.0:1788625113.840294:0:8423:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1338b3dc-3f02-4b26-a9aa-7a14f6033224/ffff99887f8c0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788625113.840314:0:8423:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788625113.840715:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:1.0:1788625113.840722:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875509185088384:12345-192.168.204.14@tcp:8: 00010000:00080000:1.0:1788625113.840742:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:1.0:1788625113.840761:0:8425:0:(genops.c:1385:class_connect()) connect: client 1338b3dc-3f02-4b26-a9aa-7a14f6033224, cookie 0x2d2e3b3f34a7a2d4 00002000:00100000:1.0:1788625113.840767:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1338b3dc-3f02-4b26-a9aa-7a14f6033224/ffff99885ee8c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788625113.840778:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788625113.840919:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788625113.840954:0:8425:0:(import.c:65:import_set_state_nolock()) ffff99885ee8a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625113.841030:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2390:x1875509185088384:12345-192.168.204.14@tcp:8: Request processed in 306us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625113.841038:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 17 00002000:00080000:2.0:1788625113.841808:0:8423:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788625113.841834:0:8423:0:(import.c:65:import_set_state_nolock()) ffff99887f8c6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625113.842954:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2390:x1875509185088256:12345-192.168.204.14@tcp:8: Request processed in 2773us (3158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625113.842967:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:3.0:1788625113.843670:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625113.845216:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185088512 00000100:00100000:2.0:1788625113.845233:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185088512 00000100:00100000:2.0:1788625113.845316:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 4 00000100:00100000:2.0:1788625113.845327:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:6150:x1875509185088512:12345-192.168.204.14@tcp:900: 00000100:00100000:2.0:1788625113.845415:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:6150:x1875509185088512:12345-192.168.204.14@tcp:900: Request processed in 90us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625113.845436:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 4 00000100:00100000:3.0:1788625113.845687:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625113.845856:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185088640 00000100:00100000:0.0:1788625113.845861:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185088640 00000100:00100000:0.0:1788625113.845906:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 196 00000100:00100000:0.0:1788625113.845913:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2393:x1875509185088640:12345-192.168.204.14@tcp:400: 00000100:00100000:0.0:1788625113.845952:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2393:x1875509185088640:12345-192.168.204.14@tcp:400: Request processed in 40us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625113.845959:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 196 00000100:00100000:3.0:1788625113.849984:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625113.850111:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185088768 00000100:00100000:2.0:1788625113.850122:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185088768 00000100:00100000:2.0:1788625113.850180:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:2.0:1788625113.850190:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:6150:x1875509185088768:12345-192.168.204.14@tcp:33: 00000004:00080000:2.0:1788625113.893315:0:6514:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 43011us 00000004:00200000:2.0:1788625113.929246:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788625113.929376:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:6150:x1875509185088768:12345-192.168.204.14@tcp:33: Request processed in 79180us (79398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625113.929386:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:2.0:1788625114.125065:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625114.132512:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185088896 00000100:00100000:0.0:1788625114.132543:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185088896 00000100:00100000:0.0:1788625114.132714:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 13 00000100:00100000:0.0:1788625114.132726:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:6191:x1875509185088896:12345-192.168.204.14@tcp:101: 00010000:00010000:0.0:1788625114.132749:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625114.132809:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a2db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3df8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625114.132913:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a2e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625114.132929:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625114.132944:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625114.132993:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788625114.132997:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625114.133013:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625114.133040:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a2db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df8e expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625114.133060:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df8e expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625114.133069:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9900) 00010000:00010000:0.0:1788625114.133072:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625114.133076:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995000, rc 0) 00000100:00100000:0.0:1788625114.133175:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:6191:x1875509185088896:12345-192.168.204.14@tcp:101: Request processed in 452us (8120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625114.133200:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 13 00010000:00010000:0.0:1788625114.187988:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625114.894732:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625114.898728:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206107520:0@lo:41: 00000100:00100000:3.0:1788625114.898843:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625114.899882:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206107520 00000100:00100000:1.0:1788625114.899894:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206107520 00000100:00100000:1.0:1788625114.899957:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788625114.899966:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206107520:12345-0@lo:41: 00000004:00000024:1.0:1788625114.900006:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788625114.900074:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206107520:12345-0@lo:41: Request processed in 109us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625114.900095:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788625114.901359:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206107520:0@lo:41: 00010000:00010000:1.0:1788625115.219191:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625115.403875:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625115.403902:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206107648:0@lo:13: 00000100:00100000:0.0:1788625115.403988:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625115.404377:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206107776:0@lo:13: 00000100:00100000:0.0:1788625115.404405:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625115.404487:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206107648 00000100:00100000:3.0:1788625115.404495:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206107648 00000100:00100000:3.0:1788625115.404564:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206107776 00000100:00100000:3.0:1788625115.404568:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206107776 00000100:00100000:3.0:1788625115.404597:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788625115.404607:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206107648:12345-0@lo:13: 00002000:00000024:3.0:1788625115.404640:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625115.404713:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206107648:12345-0@lo:13: Request processed in 106us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625115.404720:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788625115.404737:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788625115.404744:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206107776:12345-0@lo:13: 00002000:00000024:3.0:1788625115.404754:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625115.404777:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206107776:12345-0@lo:13: Request processed in 34us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625115.404783:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788625115.404901:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c2bb80 x1875509206107776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625115.404919:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206107776:0@lo:13: 00010000:00080000:1.0:1788625115.404930:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743684a80 x1875509206107648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625115.404941:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206107648:0@lo:13: 00000100:00080000:0.0:1788625115.405005:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625115.915886:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206107904:0@lo:400: 00000100:00100000:3.0:1788625115.915935:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206108160:0@lo:400: 00000100:00100000:0.0:1788625115.916055:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206108032:0@lo:400: 00000100:00100000:1.0:1788625115.916070:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206108288:0@lo:400: 00000100:00100000:3.0:1788625115.920348:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625115.920449:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206108672:0@lo:400: 00000100:00100000:3.0:1788625115.920503:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625115.920540:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206109184:0@lo:400: 00000100:00100000:3.0:1788625115.920564:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625115.920646:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206108160 00000100:00100000:3.0:1788625115.920654:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206108160 00000100:00100000:3.0:1788625115.920703:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788625115.920713:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206108160:12345-0@lo:400: 00000100:00100000:3.0:1788625115.920773:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206108160:12345-0@lo:400: Request processed in 62us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625115.920781:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788625115.920827:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206108160:0@lo:400: 00000100:00100000:3.0:1788625115.920873:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206108672 00000100:00100000:3.0:1788625115.920877:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206108672 00000100:00100000:3.0:1788625115.921270:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206109184 00000100:00100000:3.0:1788625115.921289:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206109184 00000100:00100000:3.0:1788625115.921324:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788625115.921332:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206108672:12345-0@lo:400: 00000100:00100000:3.0:1788625115.921373:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206108672:12345-0@lo:400: Request processed in 43us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625115.921379:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788625115.921393:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788625115.921399:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206109184:12345-0@lo:400: 00000100:00100000:3.0:1788625115.921426:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206109184:12345-0@lo:400: Request processed in 28us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625115.921433:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788625115.922852:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625115.922917:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206108416:0@lo:400: 00000100:00100000:2.0:1788625115.922965:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625115.923002:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206108928:0@lo:400: 00000100:00100000:2.0:1788625115.923049:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625115.923075:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206109440:0@lo:400: 00000100:00100000:2.0:1788625115.923113:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625115.923172:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206108928 00000100:00100000:2.0:1788625115.923179:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206108928 00000100:00100000:2.0:1788625115.923218:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206109440 00000100:00100000:2.0:1788625115.923221:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206109440 00000100:00100000:2.0:1788625115.923250:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788625115.923259:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206108928:12345-0@lo:400: 00000100:00100000:2.0:1788625115.923313:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206108928:12345-0@lo:400: Request processed in 55us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625115.923320:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788625115.923346:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625115.923352:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1875509206109440:12345-0@lo:400: 00000100:00100000:2.0:1788625115.923379:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1875509206109440:12345-0@lo:400: Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625115.923385:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625115.923409:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206108416 00000100:00100000:2.0:1788625115.923412:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206108416 00000100:00100000:2.0:1788625115.923435:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788625115.923441:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206108416:12345-0@lo:400: 00000100:00100000:2.0:1788625115.923468:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206108416:12345-0@lo:400: Request processed in 29us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625115.923474:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788625115.923508:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4dd500 x1875509206108928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625115.923537:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206108928:0@lo:400: 00010000:00080000:2.0:1788625115.923548:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742d26d80 x1875509206109440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625115.923557:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206109440:0@lo:400: 00000100:00100000:2.0:1788625115.923567:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206108416:0@lo:400: 00000100:00100000:2.0:1788625115.923598:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206107904 00000100:00100000:2.0:1788625115.923602:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206107904 00000100:00100000:2.0:1788625115.923629:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788625115.923643:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3637:x1875509206107904:12345-0@lo:400: 00000100:00100000:2.0:1788625115.923680:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3637:x1875509206107904:12345-0@lo:400: Request processed in 38us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625115.923686:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788625115.923717:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206107904:0@lo:400: 00010000:00080000:2.0:1788625115.923772:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4dd180 x1875509206108672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625115.923783:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206108672:0@lo:400: 00010000:00080000:2.0:1788625115.923796:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9988449ae300 x1875509206109184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625115.923803:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206109184:0@lo:400: 00000100:00080000:2.0:1788625115.923863:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625115.923867:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625115.931562:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625115.931630:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206108544:0@lo:400: 00000100:00100000:1.0:1788625115.931636:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625115.931664:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206108800:0@lo:400: 00000100:00100000:0.0:1788625115.931672:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625115.931703:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625115.931703:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206109056:0@lo:400: 00000100:00100000:0.0:1788625115.931732:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625115.931746:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206108800 00000100:00100000:1.0:1788625115.931754:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206108800 00000100:00100000:0.0:1788625115.931762:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206108032 00000100:00100000:0.0:1788625115.931767:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206108032 00000100:00100000:0.0:1788625115.931799:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206108288 00000100:00100000:0.0:1788625115.931803:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206108288 00000100:00100000:1.0:1788625115.931812:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625115.931818:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206108544 00000100:00100000:0.0:1788625115.931821:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206108544 00000100:00100000:1.0:1788625115.931838:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206108800:12345-0@lo:400: 00000100:00100000:0.0:1788625115.931844:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206109056 00000100:00100000:0.0:1788625115.931848:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206109056 00000100:00100000:0.0:1788625115.931863:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788625115.931870:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206108032:12345-0@lo:400: 00000100:00100000:0.0:1788625115.931909:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206108032:12345-0@lo:400: Request processed in 40us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625115.931916:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788625115.931950:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788625115.931955:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206108288:12345-0@lo:400: 00000100:00100000:1.0:1788625115.931981:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206108800:12345-0@lo:400: Request processed in 159us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625115.931991:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206108288:12345-0@lo:400: Request processed in 34us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625115.931992:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625115.932003:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788625115.932018:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788625115.932024:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206108544:12345-0@lo:400: 00010000:00080000:1.0:1788625115.932041:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4dca80 x1875509206108800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625115.932052:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206108544:12345-0@lo:400: Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625115.932060:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206108800:0@lo:400: 00000100:00100000:0.0:1788625115.932060:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788625115.932075:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206109312:0@lo:400: 00000100:00100000:0.0:1788625115.932075:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788625115.932084:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206109056:12345-0@lo:400: 00000100:00100000:0.0:1788625115.932117:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206109056:12345-0@lo:400: Request processed in 35us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625115.932122:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625115.932127:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788625115.932142:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625115.932174:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206109312 00000100:00100000:1.0:1788625115.932180:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206109312 00000100:00100000:0.0:1788625115.932180:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206109056:0@lo:400: 00000100:00080000:0.0:1788625115.932207:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625115.932223:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206108032:0@lo:400: 00000100:00100000:1.0:1788625115.932229:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625115.932235:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206108544:0@lo:400: 00000100:00100000:1.0:1788625115.932241:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1875509206109312:12345-0@lo:400: 00000100:00100000:1.0:1788625115.932279:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1875509206109312:12345-0@lo:400: Request processed in 43us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625115.932285:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788625115.932703:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742d25880 x1875509206109312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625115.932715:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206109312:0@lo:400: 00000100:00100000:0.0:1788625115.932735:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206108288:0@lo:400: 00010000:00010000:0.0:1788625116.235868:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625116.427864:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206109568:0@lo:41: 00000100:00100000:0.0:1788625116.427953:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625116.428184:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206109568 00000100:00100000:1.0:1788625116.428193:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206109568 00000100:00100000:1.0:1788625116.428251:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788625116.428263:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206109568:12345-0@lo:41: 00000004:00000024:1.0:1788625116.428300:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788625116.428359:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206109568:12345-0@lo:41: Request processed in 99us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625116.428366:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788625116.428456:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206109568:0@lo:41: 00000100:00100000:3.0:1788625116.428559:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206109696:0@lo:13: 00000100:00100000:3.0:1788625116.428593:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625116.428654:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206109696 00000100:00100000:0.0:1788625116.428659:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206109696 00000100:00100000:0.0:1788625116.428693:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788625116.428700:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206109696:12345-0@lo:13: 00002000:00000024:0.0:1788625116.428734:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625116.428880:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206109824:0@lo:13: 00000100:00100000:2.0:1788625116.432730:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625116.432817:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788625116.432829:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1788625116.433001:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206109824 00000100:00100000:2.0:1788625116.433010:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206109824 00000100:00100000:2.0:1788625116.433130:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788625116.433141:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1875509206109824:12345-0@lo:13: 00002000:00000024:2.0:1788625116.433177:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625116.433235:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1875509206109824:12345-0@lo:13: Request processed in 96us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625116.433243:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788625116.433594:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c28700 x1875509206109824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625116.433920:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206109824:0@lo:13: 00000100:00100000:0.0:1788625116.448101:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206109696:12345-0@lo:13: Request processed in 19388us (19494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625116.448118:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788625116.448256:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bca80 x1875509206109696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625116.448283:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206109696:0@lo:13: 00000100:00100000:3.0:1788625116.826295:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625116.826466:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185089024 00000100:00100000:0.0:1788625116.826477:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185089024 00000100:00100000:0.0:1788625116.826882:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00100000:0.0:1788625116.826893:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:6243:x1875509185089024:12345-192.168.204.14@tcp:41: 00000004:00000024:0.0:1788625116.826947:0:9824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788625116.827022:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:6243:x1875509185089024:12345-192.168.204.14@tcp:41: Request processed in 130us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625116.827029:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00080000:2.0:1788625116.829005:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625116.833939:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625116.834158:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185089152 00000100:00100000:2.0:1788625116.834173:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185089152 00000100:00100000:2.0:1788625116.834371:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00100000:2.0:1788625116.834386:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:6243:x1875509185089152:12345-192.168.204.14@tcp:41: 00000004:00000024:2.0:1788625116.834423:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:0.0:1788625116.835124:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788625116.835407:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:6243:x1875509185089152:12345-192.168.204.14@tcp:41: Request processed in 1021us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625116.835417:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00100000:3.0:1788625116.848512:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625116.849262:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185089280 00000100:00100000:2.0:1788625116.849274:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185089280 00000100:00100000:2.0:1788625116.849354:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:2.0:1788625116.849376:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:6243:x1875509185089280:12345-192.168.204.14@tcp:13: 00002000:00000024:2.0:1788625116.849404:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625116.849487:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:6243:x1875509185089280:12345-192.168.204.14@tcp:13: Request processed in 113us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625116.849495:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00080000:0.0:1788625116.850820:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625116.855080:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625116.855554:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185089408 00000100:00100000:0.0:1788625116.855575:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185089408 00000100:00100000:0.0:1788625116.855654:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:0.0:1788625116.855664:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:6243:x1875509185089408:12345-192.168.204.14@tcp:13: 00002000:00000024:0.0:1788625116.855706:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625116.855777:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:6243:x1875509185089408:12345-192.168.204.14@tcp:13: Request processed in 114us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625116.855785:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00080000:2.0:1788625116.857969:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1788625116.950176:0:9503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000001:00080000:3.0:1788625116.950203:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1788625116.950215:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788625117.260039:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625118.286476:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788625118.996218:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000001:00100000:0.0:1788625118.997971:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000100:00100000:1.0:1788625119.227993:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625119.228039:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625119.228074:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625119.228111:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625119.228136:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625119.228227:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185090048 00000100:00100000:1.0:1788625119.228237:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185090048 00000100:00100000:1.0:1788625119.228298:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185089920 00000100:00100000:1.0:1788625119.228316:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185089920 00000100:00100000:1.0:1788625119.228346:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 13 00000100:00100000:1.0:1788625119.228356:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2392:x1875509185090048:12345-192.168.204.14@tcp:400: 00000100:00100000:2.0:1788625119.228468:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185089792 00000100:00100000:2.0:1788625119.228482:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185089792 00000100:00100000:2.0:1788625119.228590:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185089664 00000100:00100000:2.0:1788625119.228594:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185089664 00000100:00100000:2.0:1788625119.228632:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00100000:2.0:1788625119.228642:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2392:x1875509185089792:12345-192.168.204.14@tcp:400: 00000100:00100000:1.0:1788625119.228721:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2392:x1875509185090048:12345-192.168.204.14@tcp:400: Request processed in 362us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625119.228731:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 13 00000100:00100000:2.0:1788625119.228755:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2392:x1875509185089792:12345-192.168.204.14@tcp:400: Request processed in 96us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625119.228764:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00100000:2.0:1788625119.228777:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00100000:1.0:1788625119.228785:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2392:x1875509185089920:12345-192.168.204.14@tcp:400: 00000100:00100000:2.0:1788625119.228812:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00100000:2.0:1788625119.228823:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2392:x1875509185089664:12345-192.168.204.14@tcp:400: 00000100:00100000:1.0:1788625119.228833:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2392:x1875509185089920:12345-192.168.204.14@tcp:400: Request processed in 49us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625119.228842:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00100000:2.0:1788625119.228869:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2392:x1875509185089664:12345-192.168.204.14@tcp:400: Request processed in 46us (754us total) trans 0 rc 0/0 00000100:00080000:1.0:1788625119.228877:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625119.228878:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00080000:1.0:1788625119.228892:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625119.228900:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788625119.228903:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625119.242997:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185089536 00000100:00100000:3.0:1788625119.243024:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185089536 00000100:00100000:3.0:1788625119.243099:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 198 00000100:00100000:3.0:1788625119.243110:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2392:x1875509185089536:12345-192.168.204.14@tcp:400: 00000100:00100000:3.0:1788625119.243233:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2392:x1875509185089536:12345-192.168.204.14@tcp:400: Request processed in 123us (15248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625119.243240:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 198 00010000:00010000:1.0:1788625119.308917:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625120.014360:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625120.014401:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206109952:0@lo:41: 00000100:00100000:0.0:1788625120.014507:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625120.014630:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206109952 00000100:00100000:0.0:1788625120.014642:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206109952 00000100:00100000:0.0:1788625120.014709:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788625120.014720:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206109952:12345-0@lo:41: 00000004:00000024:0.0:1788625120.014768:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788625120.014826:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206109952:12345-0@lo:41: Request processed in 107us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625120.014850:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788625120.014910:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206109952:0@lo:41: 00000001:00100000:2.0:1788625120.020190:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1338b3dc-3f02-4b26-a9aa-7a14f6033224 00010000:00010000:2.0:1788625120.333844:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788625120.378308:0:10176:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788625120.529087:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625120.529111:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206110080:0@lo:13: 00000100:00100000:0.0:1788625120.529197:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625120.529266:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206110080 00000100:00100000:0.0:1788625120.529275:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206110080 00000100:00100000:0.0:1788625120.529339:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788625120.529350:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206110080:12345-0@lo:13: 00002000:00000024:0.0:1788625120.529382:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625120.529441:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206110080:12345-0@lo:13: Request processed in 93us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625120.529448:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788625120.529470:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788625120.529501:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742e43480 x1875509206110080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625120.529554:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206110080:0@lo:13: 00000100:00100000:2.0:1788625120.530761:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206110208:0@lo:13: 00000100:00100000:2.0:1788625120.530816:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625120.531213:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206110208 00000100:00100000:3.0:1788625120.531221:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206110208 00000100:00100000:3.0:1788625120.531288:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788625120.531298:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206110208:12345-0@lo:13: 00002000:00000024:3.0:1788625120.531320:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625120.531370:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206110208:12345-0@lo:13: Request processed in 73us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625120.531376:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788625120.531442:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742d26d80 x1875509206110208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625120.531458:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206110208:0@lo:13: 00000100:00080000:0.0:1788625120.531512:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625121.036829:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206110336:0@lo:400: 00000100:00100000:2.0:1788625121.036915:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625121.036971:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206110848:0@lo:400: 00000100:00100000:2.0:1788625121.037000:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625121.037021:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206111360:0@lo:400: 00000100:00100000:2.0:1788625121.037044:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625121.037082:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206111872:0@lo:400: 00000100:00100000:2.0:1788625121.037106:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625121.037131:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788625121.037137:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206110720:0@lo:400: 00000100:00100000:2.0:1788625121.037164:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625121.037182:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206111232:0@lo:400: 00000100:00100000:2.0:1788625121.037223:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625121.037485:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206110464:0@lo:400: 00000100:00100000:0.0:1788625121.037578:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625121.037616:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206110976:0@lo:400: 00000100:00100000:0.0:1788625121.037642:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625121.037661:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206111488:0@lo:400: 00000100:00100000:0.0:1788625121.037684:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625121.037714:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788625121.037724:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206110592:0@lo:400: 00000100:00100000:0.0:1788625121.037773:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625121.037794:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206111104:0@lo:400: 00000100:00100000:0.0:1788625121.037814:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625121.037826:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206111616:0@lo:400: 00000100:00100000:0.0:1788625121.037851:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625121.037910:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206110848 00000100:00100000:1.0:1788625121.037925:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206110848 00000100:00100000:1.0:1788625121.037976:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206110592 00000100:00100000:1.0:1788625121.037980:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206110592 00000100:00100000:1.0:1788625121.038002:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788625121.038013:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206110848:12345-0@lo:400: 00000100:00100000:0.0:1788625121.038128:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206111360 00000100:00100000:0.0:1788625121.038139:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206111360 00000100:00100000:2.0:1788625121.038191:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206111744:0@lo:400: 00000100:00100000:0.0:1788625121.038201:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206111872 00000100:00100000:0.0:1788625121.038206:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206111872 00000100:00100000:2.0:1788625121.038277:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625121.038282:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206110848:12345-0@lo:400: Request processed in 268us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625121.038319:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206110848:0@lo:400: 00000100:00100000:2.0:1788625121.038354:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206110720 00000100:00100000:1.0:1788625121.038359:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788625121.038360:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206110720 00000100:00100000:2.0:1788625121.038390:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206110464 00000100:00100000:2.0:1788625121.038393:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206110464 00000100:00100000:1.0:1788625121.038400:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788625121.038409:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206110976 00000100:00100000:2.0:1788625121.038413:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206110976 00000100:00100000:1.0:1788625121.038423:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206110592:12345-0@lo:400: 00000100:00100000:2.0:1788625121.038478:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206111488 00000100:00100000:2.0:1788625121.038484:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206111488 00000100:00100000:2.0:1788625121.038502:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206111104 00000100:00100000:2.0:1788625121.038506:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206111104 00000100:00100000:2.0:1788625121.038583:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206111616 00000100:00100000:2.0:1788625121.038588:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206111616 00000100:00100000:1.0:1788625121.038593:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206110592:12345-0@lo:400: Request processed in 155us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625121.038604:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788625121.038609:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788625121.038616:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206110720:12345-0@lo:400: 00000100:00100000:2.0:1788625121.038659:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206110720:12345-0@lo:400: Request processed in 43us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625121.038667:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788625121.038681:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788625121.038946:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206110464:12345-0@lo:400: 00000100:00100000:2.0:1788625121.038982:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206110464:12345-0@lo:400: Request processed in 295us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625121.038989:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788625121.039002:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788625121.039008:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206110976:12345-0@lo:400: 00000100:00100000:1.0:1788625121.039110:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206110336 00000100:00100000:1.0:1788625121.039115:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206110336 00000100:00100000:2.0:1788625121.039121:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206110976:12345-0@lo:400: Request processed in 40us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625121.039130:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788625121.039145:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788625121.039154:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788625121.039155:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206111488:12345-0@lo:400: 00000100:00100000:2.0:1788625121.039187:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206111488:12345-0@lo:400: Request processed in 35us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625121.039195:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788625121.039207:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788625121.039216:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206111104:12345-0@lo:400: 00000100:00100000:1.0:1788625121.039224:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206110336:12345-0@lo:400: 00000100:00100000:1.0:1788625121.039354:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206110336:12345-0@lo:400: Request processed in 158us (2436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625121.039364:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206111104:12345-0@lo:400: Request processed in 148us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625121.039369:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788625121.039378:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788625121.039403:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788625121.039414:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206111616:12345-0@lo:400: 00000100:00100000:0.0:1788625121.039425:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206111232 00000100:00100000:0.0:1788625121.039433:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206111232 00000100:00100000:1.0:1788625121.039442:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206111744 00000100:00100000:1.0:1788625121.039450:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206111744 00000100:00100000:2.0:1788625121.039451:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206111616:12345-0@lo:400: Request processed in 40us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625121.039464:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788625121.039483:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625121.039496:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206111360:12345-0@lo:400: 00000100:00100000:1.0:1788625121.039594:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788625121.039602:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206111360:12345-0@lo:400: Request processed in 108us (2555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625121.039615:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625121.039636:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788625121.039646:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206111232:12345-0@lo:400: 00000100:00100000:0.0:1788625121.039692:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206111232:12345-0@lo:400: Request processed in 49us (2468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625121.039702:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788625121.039718:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788625121.039727:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206111744:12345-0@lo:400: 00000100:00080000:2.0:1788625121.039734:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625121.039742:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788625121.039744:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625121.039747:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206111872:12345-0@lo:400: 00000100:00100000:2.0:1788625121.039779:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206110720:0@lo:400: 00010000:00080000:2.0:1788625121.039803:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bf100 x1875509206111232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625121.039815:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206111232:0@lo:400: 00000100:00100000:1.0:1788625121.039835:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206111872:12345-0@lo:400: Request processed in 230us (2727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625121.039842:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206110336:0@lo:400: 00000100:00100000:1.0:1788625121.039855:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788625121.039857:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bf480 x1875509206111360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625121.039868:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206111360:0@lo:400: 00010000:00080000:2.0:1788625121.039881:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bc000 x1875509206111872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625121.039889:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788625121.039902:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206111872:0@lo:400: 00000100:00100000:1.0:1788625121.039943:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206110592:0@lo:400: 00010000:00080000:1.0:1788625121.039957:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bd180 x1875509206111104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625121.040015:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206111104:0@lo:400: 00010000:00080000:1.0:1788625121.040031:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8be680 x1875509206111616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625121.040040:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206111616:0@lo:400: 00000100:00100000:1.0:1788625121.040064:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206110464:0@lo:400: 00000100:00100000:1.0:1788625121.040085:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206110976:0@lo:400: 00000100:00100000:1.0:1788625121.040094:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206111488:0@lo:400: 00000100:00100000:0.0:1788625121.041943:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206111744:12345-0@lo:400: Request processed in 2202us (3651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625121.041961:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788625121.041985:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bdc00 x1875509206111744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625121.042005:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788625121.042038:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206111744:0@lo:400: 00010000:00010000:2.0:1788625121.356951:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625121.548254:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625121.548281:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206112000:0@lo:13: 00000100:00100000:2.0:1788625121.548350:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625121.549055:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625121.549069:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206112128:0@lo:41: 00000100:00100000:0.0:1788625121.549119:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625121.549201:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206112128 00000100:00100000:0.0:1788625121.549209:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206112128 00000100:00100000:0.0:1788625121.549281:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788625121.549291:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206112128:12345-0@lo:41: 00000004:00000024:0.0:1788625121.549325:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788625121.549366:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206112128:12345-0@lo:41: Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625121.549373:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788625121.549414:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206112128:0@lo:41: 00000100:00100000:1.0:1788625121.549833:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206112000 00000100:00100000:1.0:1788625121.549840:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206112000 00000100:00100000:1.0:1788625121.549917:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625121.549926:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206112000:12345-0@lo:13: 00002000:00000024:1.0:1788625121.549948:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625121.549988:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206112000:12345-0@lo:13: Request processed in 64us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625121.549995:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788625121.550078:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99885eec4380 x1875509206112000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625121.550095:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206112000:0@lo:13: 00000100:00100000:1.0:1788625121.553832:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625121.553863:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206112256:0@lo:13: 00000100:00100000:1.0:1788625121.553942:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625121.554065:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206112256 00000100:00100000:2.0:1788625121.554073:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206112256 00000100:00100000:2.0:1788625121.554133:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788625121.554143:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206112256:12345-0@lo:13: 00002000:00000024:2.0:1788625121.554168:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625121.554230:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206112256:12345-0@lo:13: Request processed in 89us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625121.554239:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788625121.557763:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4dea00 x1875509206112256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625121.557793:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206112256:0@lo:13: 00010000:00010000:2.0:1788625122.379986:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625123.405672:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788625123.869229:0:10324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc66e5d80 20000000:00000080:0.0:1788625123.869249:0:10324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99887f8cd000 uarg=0000000000000000 20000000:01000000:0.0:1788625123.869297:0:10324:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788625123.869300:0:10324:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788625123.869304:0:10324:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788625123.869309:0:10324:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788625123.869314:0:10324:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788625123.869378:0:10324:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788625123.869381:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788625123.870321:0:10325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1788625123.870807:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1788625123.870841:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1788625123.870856:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1788625123.870868:0:10324:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788625123.870870:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788625123.874156:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1788625123.876954:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1788625123.877018:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1788625123.877038:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1788625123.877057:0:10324:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788625123.877060:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788625123.877990:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1788625123.878232:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1788625123.878259:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1788625123.878272:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1788625123.878282:0:10324:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788625123.878285:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788625123.878704:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1788625123.878856:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1788625123.878879:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1788625123.878910:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1788625123.878922:0:10324:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788625123.878924:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788625123.879279:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1788625123.879419:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1788625123.879439:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1788625123.879456:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:3.0:1788625123.879469:0:10324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788625123.879498:0:10324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7a2e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.879558:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887b683c00/0x2d2e3b3f34a7a184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a17d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.879567:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7a1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a1a7 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.879576:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a1ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a1e6 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.879583:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887cac7000/0x2d2e3b3f34a7a1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a1f4 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.879590:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998859be8e00/0x2d2e3b3f34a7a209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a202 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.879597:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a21e expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.879604:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a24f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a248 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.879612:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887c995a00/0x2d2e3b3f34a7a26b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a264 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.879619:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998859be8200/0x2d2e3b3f34a7a295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a287 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.879631:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887c994800/0x2d2e3b3f34a7a2a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df1e expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.879650:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df25 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.879659:0:10324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7a2e9 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.879705:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df25 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.879721:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a2aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df25 expref: 9 pid: 6506 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.879736:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206112384:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625123.880072:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887c994800/0x2d2e3b3f34a7a2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df1e expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.880081:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99887c994800/0x2d2e3b3f34a7a2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df1e expref: 9 pid: 6505 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.880090:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844937480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206112512:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625123.880123:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998859be8200/0x2d2e3b3f34a7a295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a287 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.880131:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998859be8200/0x2d2e3b3f34a7a295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a287 expref: 23 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.880140:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206112640:0@lo:104: 00000100:00100000:3.0:1788625123.880194:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625123.880247:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887c995a00/0x2d2e3b3f34a7a26b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a264 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.880255:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887c995a00/0x2d2e3b3f34a7a26b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a264 expref: 23 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.880264:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206112768:0@lo:104: 00000100:00100000:3.0:1788625123.880288:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625123.880323:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a248 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.880331:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a24f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a248 expref: 23 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.880339:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206112896:0@lo:104: 00000100:00100000:3.0:1788625123.880358:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625123.880384:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a21e expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.880392:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a225 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a21e expref: 23 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.880400:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206113024:0@lo:104: 00000100:00100000:3.0:1788625123.880424:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625123.880439:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998859be8e00/0x2d2e3b3f34a7a209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a202 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.880447:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998859be8e00/0x2d2e3b3f34a7a209 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a202 expref: 23 pid: 6505 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.880455:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206113152:0@lo:104: 00010000:00010000:3.0:1788625123.880497:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887cac7000/0x2d2e3b3f34a7a1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1f4 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.880506:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887cac7000/0x2d2e3b3f34a7a1fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1f4 expref: 23 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.880513:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206113280:0@lo:104: 00010000:00010000:3.0:1788625123.880570:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a1ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1e6 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.880579:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a1ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1e6 expref: 23 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.880587:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206113408:0@lo:104: 00010000:00010000:3.0:1788625123.880613:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7a1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1a7 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.880622:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7a1ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1a7 expref: 23 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.880630:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206113536:0@lo:104: 00010000:00010000:3.0:1788625123.880660:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887b683c00/0x2d2e3b3f34a7a184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a17d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.880670:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887b683c00/0x2d2e3b3f34a7a184 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a17d expref: 23 pid: 6505 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.880679:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206113664:0@lo:104: 00000100:00100000:3.0:1788625123.880699:0:10324:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625123.880796:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788625123.880815:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206112640 00000100:00100000:2.0:1788625123.880821:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625123.880824:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206112640 00000100:00100000:1.0:1788625123.880827:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206112768 00000100:00100000:2.0:1788625123.880841:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625123.880841:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206112768 00000100:00100000:2.0:1788625123.880863:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625123.880865:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206112896 00000100:00100000:0.0:1788625123.880871:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206112896 00000100:00100000:1.0:1788625123.880875:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206113024 00000100:00100000:1.0:1788625123.880880:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206113024 00000100:00100000:0.0:1788625123.880898:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206113152 00000100:00100000:1.0:1788625123.880902:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206113280 00000100:00100000:2.0:1788625123.880903:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625123.880904:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206113152 00000100:00100000:1.0:1788625123.880908:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206113280 00000100:00100000:2.0:1788625123.880921:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625123.880928:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206113408 00000100:00100000:0.0:1788625123.880933:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206113408 00000100:00100000:1.0:1788625123.880934:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206113536 00000100:00100000:2.0:1788625123.880935:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206113664 00000100:00100000:1.0:1788625123.880940:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206113536 00000100:00100000:2.0:1788625123.880941:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206113664 00000100:00100000:0.0:1788625123.880957:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788625123.880976:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:10324:x1875509206112640:12345-0@lo:104: 00010000:00010000:0.0:1788625123.880990:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a295 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.881065:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788625123.881072:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+11:10324:x1875509206112640:12345-0@lo:104: Request processed in 99us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625123.881198:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206112640:0@lo:104: 00000100:00100000:0.0:1788625123.881496:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788625123.881504:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625123.881513:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788625123.881546:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+10:10324:x1875509206112768:12345-0@lo:104: 00000100:00100000:2.0:1788625123.881556:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+10:10324:x1875509206112896:12345-0@lo:104: 00010000:00010000:1.0:1788625123.881558:0:8440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a26b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.881571:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7a248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a24f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.881609:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625123.881617:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a295 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.881625:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6a00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625123.881630:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a295 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.881638:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a295 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625123.881645:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a295 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625123.881651:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788625123.881733:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625123.881739:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+10:10324:x1875509206112768:12345-0@lo:104: Request processed in 228us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625123.881747:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788625123.881762:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788625123.881770:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+9:10324:x1875509206113024:12345-0@lo:104: 00010000:00010000:3.0:1788625123.881784:0:8440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887c995400/0x2d2e3b3f34a7a21e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a225 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.881824:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625123.881830:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625123.881837:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+9:10324:x1875509206113024:12345-0@lo:104: Request processed in 69us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625123.881844:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788625123.881858:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788625123.881866:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+8:10324:x1875509206113152:12345-0@lo:104: 00010000:00010000:3.0:1788625123.881874:0:8440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887b683800/0x2d2e3b3f34a7a202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a209 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625123.881877:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206112768:0@lo:104: 00010000:00010000:3.0:1788625123.881910:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788625123.881916:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+8:10324:x1875509206113152:12345-0@lo:104: Request processed in 52us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625123.881921:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788625123.881933:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788625123.881939:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+7:10324:x1875509206113280:12345-0@lo:104: 00010000:00010000:3.0:1788625123.881947:0:8440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887c994a00/0x2d2e3b3f34a7a1f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a1fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.881988:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788625123.882004:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+7:10324:x1875509206113280:12345-0@lo:104: Request processed in 55us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625123.882010:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788625123.882023:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788625123.882029:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743686d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:10324:x1875509206113408:12345-0@lo:104: 00010000:00010000:3.0:1788625123.882036:0:8440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a1e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a1ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.882063:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788625123.882068:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743686d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:10324:x1875509206113408:12345-0@lo:104: Request processed in 40us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625123.882074:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788625123.882085:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788625123.882091:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:10324:x1875509206113536:12345-0@lo:104: 00010000:00010000:3.0:1788625123.882099:0:8440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a7a1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a1ae expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.882124:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788625123.882129:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:10324:x1875509206113536:12345-0@lo:104: Request processed in 39us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625123.882134:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788625123.882144:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788625123.882150:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:10324:x1875509206113664:12345-0@lo:104: 00010000:00010000:3.0:1788625123.882158:0:8440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a184 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.882192:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788625123.882197:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:10324:x1875509206113664:12345-0@lo:104: Request processed in 47us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625123.882203:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788625123.882229:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206113024:0@lo:104: 00000100:00100000:2.0:1788625123.882239:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206113152:0@lo:104: 00000100:00100000:2.0:1788625123.882249:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206113280:0@lo:104: 00000100:00100000:2.0:1788625123.882262:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206113408:0@lo:104: 00010000:00010000:3.0:1788625123.882267:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788625123.882276:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206113536:0@lo:104: 00000100:00100000:3.0:1788625123.882277:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:10324:x1875509206112896:12345-0@lo:104: Request processed in 723us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625123.882287:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788625123.882290:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206113664:0@lo:104: 00000100:00100000:2.0:1788625123.882304:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206112896:0@lo:104: 00010000:00010000:0.0:1788625123.882399:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a295 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.882407:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788625123.882611:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206113792:0@lo:103: 00000100:00100000:2.0:1788625123.882653:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625123.882832:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a287 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a295 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.882840:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a287 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a295 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.882865:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788625123.882869:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887c995400/0x2d2e3b3f34a7a21e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a225 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.882874:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995400 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625123.882878:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887c995400/0x2d2e3b3f34a7a21e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a225 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.882885:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887c995400/0x2d2e3b3f34a7a21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a225 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625123.882891:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887c995400/0x2d2e3b3f34a7a21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a225 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625123.882896:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625123.882927:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887c995400/0x2d2e3b3f34a7a21e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a225 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.882933:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625123.882948:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887c995400/0x2d2e3b3f34a7a21e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a225 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.882955:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887c995400/0x2d2e3b3f34a7a21e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a225 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.882963:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788625123.882966:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b683800/0x2d2e3b3f34a7a202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a209 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.882983:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625123.882986:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b683800/0x2d2e3b3f34a7a202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a209 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883005:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b683800/0x2d2e3b3f34a7a202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a209 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625123.883013:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b683800/0x2d2e3b3f34a7a202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a209 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625123.883018:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625123.883033:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b683800/0x2d2e3b3f34a7a202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a209 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883040:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625123.883045:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b683800/0x2d2e3b3f34a7a202 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a209 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883051:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b683800/0x2d2e3b3f34a7a202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a209 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883060:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788625123.883063:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887c994a00/0x2d2e3b3f34a7a1f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a1fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883069:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994a00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625123.883072:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887c994a00/0x2d2e3b3f34a7a1f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a1fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883089:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887c994a00/0x2d2e3b3f34a7a1f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a1fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625123.883094:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887c994a00/0x2d2e3b3f34a7a1f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a1fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625123.883099:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625123.883112:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887c994a00/0x2d2e3b3f34a7a1f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a1fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883117:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788625123.883197:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206114176:0@lo:103: 00000100:00100000:3.0:1788625123.883229:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625123.883303:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206113792 00000100:00100000:1.0:1788625123.883309:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206113792 00010000:00010000:1.0:1788625123.883333:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998859be8200/0x2d2e3b3f34a7a295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a287 expref: 24 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625123.883366:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206114176 00000100:00100000:1.0:1788625123.883370:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206114176 00010000:00010000:1.0:1788625123.883383:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887cac7000/0x2d2e3b3f34a7a1fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1f4 expref: 25 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625123.883392:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788625123.883404:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+25:3636:x1875509206113792:12345-0@lo:103: 00010000:00010000:2.0:1788625123.883417:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625123.883423:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998859be8200/0x2d2e3b3f34a7a295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a287 expref: 25 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.883441:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998859be8200/0x2d2e3b3f34a7a295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a287 expref: 25 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.883454:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be8200/0x2d2e3b3f34a7a295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a287 expref: 25 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.883468:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625123.883544:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887c994a00/0x2d2e3b3f34a7a1f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a1fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883553:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887c994a00/0x2d2e3b3f34a7a1f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a1fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883565:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788625123.883569:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a1e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a1ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883575:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625123.883582:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a1e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a1ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883589:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a1e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a1ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625123.883595:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a1e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a1ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625123.883606:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788625123.883625:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206113792:12345-0@lo:103: Request processed in 222us (970us total) trans 0 rc 0/0 00010000:00010000:0.0:1788625123.883629:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a1e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a1ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883637:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625123.883647:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a1e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a1ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883654:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a1e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a1ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883662:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788625123.883665:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a7a1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a1ae expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883672:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994200 already unused, calling callback (ffffffffc13d7c20) 00000100:00100000:3.0:1788625123.883673:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206113792:0@lo:103: 10000000:00010000:0.0:1788625123.883676:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a7a1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a1ae expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883685:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a7a1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a1ae expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625123.883691:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a7a1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a1ae expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625123.883696:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788625123.883699:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206114304:0@lo:103: 00010000:00010000:0.0:1788625123.883710:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a7a1a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a1ae expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883717:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625123.883728:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a7a1a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a1ae expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.883734:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625123.883741:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887c994200/0x2d2e3b3f34a7a1a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a1ae expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883751:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788625123.883754:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a184 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883761:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625123.883764:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a184 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883771:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a17d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a184 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625123.883778:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a17d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a184 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.883779:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206114304 00000100:00100000:3.0:1788625123.883784:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206114304 10000000:01000000:0.0:1788625123.883786:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625123.883804:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a17d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a184 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.883811:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a1ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1e6 expref: 25 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883812:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625123.883824:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a17d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a184 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883833:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a17d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a184 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883846:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625123.883854:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7a248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a24f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883865:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625123.883868:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7a248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a24f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883875:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7a248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a24f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625123.883881:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7a248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a24f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625123.883886:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625123.883901:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7a248 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a24f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883905:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625123.883913:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7a248 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a24f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883917:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7a248 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a24f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.883923:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625123.883924:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625123.883925:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625123.883937:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206113920:0@lo:103: 00000100:00100000:0.0:1788625123.883968:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625123.883988:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206114432:0@lo:103: 00000100:00100000:0.0:1788625123.884030:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625123.884044:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788625123.884049:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206114048:0@lo:103: 00000100:00100000:0.0:1788625123.884078:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625123.884092:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206114560:0@lo:103: 00000100:00100000:0.0:1788625123.884112:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625123.884139:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206113920 00000100:00100000:0.0:1788625123.884143:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206113920 00010000:00010000:0.0:1788625123.884159:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a225 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a21e expref: 26 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625123.884310:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788625123.884313:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206114432 00000100:00100000:1.0:1788625123.884318:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206114432 00000100:00100000:3.0:1788625123.884324:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206114048 00000100:00100000:0.0:1788625123.884327:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206114560 00000100:00100000:3.0:1788625123.884330:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206114048 00000100:00100000:0.0:1788625123.884332:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206114560 00010000:00010000:1.0:1788625123.884336:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7a1ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1a7 expref: 27 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.884349:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998859be8e00/0x2d2e3b3f34a7a209 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a202 expref: 28 pid: 6505 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.884352:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887b683c00/0x2d2e3b3f34a7a184 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a17d expref: 28 pid: 6505 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625123.884354:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625123.884372:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788625123.884381:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+28:3636:x1875509206114304:12345-0@lo:103: 00000100:00100000:3.0:1788625123.884382:0:9513:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788625123.884386:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788625123.884390:0:9513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1788625123.884390:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625123.884396:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a1ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1e6 expref: 28 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625123.884401:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788625123.884412:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a1ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1e6 expref: 28 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625123.884416:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+28:3637:x1875509206113920:12345-0@lo:103: 00010000:00010000:0.0:1788625123.884432:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625123.884436:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a1ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1e6 expref: 28 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.884440:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a225 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a21e expref: 28 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.884456:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a21e expref: 27 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.884464:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625123.884470:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac7c00/0x2d2e3b3f34a7a225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a21e expref: 27 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.884481:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625123.884496:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+26:3636:x1875509206114304:12345-0@lo:103: Request processed in 115us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625123.884503:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788625123.884538:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1788625123.884551:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788625123.884564:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+25:3637:x1875509206113920:12345-0@lo:103: Request processed in 150us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625123.884567:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+25:3637:x1875509206114432:12345-0@lo:103: 00000100:00100000:0.0:1788625123.884579:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788625123.884580:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206113920:0@lo:103: 00010000:00010000:2.0:1788625123.884580:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625123.884587:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7a1ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1a7 expref: 25 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.884595:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7a1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1a7 expref: 24 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625123.884600:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:2.0:1788625123.884607:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7a1ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1a7 expref: 24 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625123.884613:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788625123.884624:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625123.884626:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:3637:x1875509206114048:12345-0@lo:103: 00010000:00010000:0.0:1788625123.884637:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625123.884643:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998859be8e00/0x2d2e3b3f34a7a209 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a202 expref: 23 pid: 6505 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625123.884652:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998859be8e00/0x2d2e3b3f34a7a209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a202 expref: 23 pid: 6505 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625123.884659:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:3637:x1875509206114432:12345-0@lo:103: Request processed in 94us (625us total) trans 0 rc 0/0 00010000:00010000:0.0:1788625123.884669:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be8e00/0x2d2e3b3f34a7a209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a202 expref: 23 pid: 6505 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.884670:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206114432:0@lo:103: 00000100:00100000:2.0:1788625123.884670:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788625123.884684:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1788625123.884692:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1788625123.884695:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625123.884700:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:3637:x1875509206114560:12345-0@lo:103: 00010000:00010000:2.0:1788625123.884710:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625123.884715:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887b683c00/0x2d2e3b3f34a7a184 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a17d expref: 21 pid: 6505 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.884724:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887b683c00/0x2d2e3b3f34a7a184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a17d expref: 21 pid: 6505 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625123.884736:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:3637:x1875509206114048:12345-0@lo:103: Request processed in 112us (655us total) trans 0 rc 0/0 00010000:00010000:2.0:1788625123.884737:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b683c00/0x2d2e3b3f34a7a184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a17d expref: 21 pid: 6505 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.884747:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206114048:0@lo:103: 00000100:00100000:0.0:1788625123.884752:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788625123.884755:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625123.884785:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206114688:0@lo:103: 00000100:00100000:2.0:1788625123.884788:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:3637:x1875509206114560:12345-0@lo:103: Request processed in 87us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625123.884800:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206114560:0@lo:103: 00000100:00100000:2.0:1788625123.884802:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788625123.884822:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625123.884852:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206114688 00000100:00100000:3.0:1788625123.884857:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206114688 00010000:00010000:3.0:1788625123.884874:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a24f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a248 expref: 19 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.884904:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788625123.884912:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:3635:x1875509206114688:12345-0@lo:103: 00010000:00010000:3.0:1788625123.884920:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625123.884926:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a24f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a248 expref: 19 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.884935:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a248 expref: 19 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.884946:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c994c00/0x2d2e3b3f34a7a24f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a248 expref: 19 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.884955:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625123.884988:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:3635:x1875509206114688:12345-0@lo:103: Request processed in 77us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625123.885008:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788625123.885038:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206114688:0@lo:103: 00000100:00100000:1.0:1788625123.885052:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:3635:x1875509206114176:12345-0@lo:103: 00010000:00010000:1.0:1788625123.885064:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625123.885070:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887cac7000/0x2d2e3b3f34a7a1fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1f4 expref: 17 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625123.885083:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206114304:0@lo:103: 00010000:00010000:1.0:1788625123.885127:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887cac7000/0x2d2e3b3f34a7a1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1f4 expref: 17 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625123.885142:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac7000/0x2d2e3b3f34a7a1fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a1f4 expref: 17 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625123.885152:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625123.885192:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:3635:x1875509206114176:12345-0@lo:103: Request processed in 829us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625123.885199:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1788625123.885224:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625123.885228:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625123.885231:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625123.885254:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206114176:0@lo:103: 00010000:00010000:3.0:1788625123.885339:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a26b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.885347:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625123.885355:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a26b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.885361:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a26b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625123.885366:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a26b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625123.885369:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788625123.885395:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a26b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.885398:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625123.885418:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a264 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a26b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.885424:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887cac7800/0x2d2e3b3f34a7a264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a26b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.885434:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625123.885435:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625123.885436:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625123.885452:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206114816:0@lo:103: 00000100:00100000:0.0:1788625123.885481:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625123.885619:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206114816 00000100:00100000:3.0:1788625123.885623:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206114816 00010000:00010000:3.0:1788625123.885637:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887c995a00/0x2d2e3b3f34a7a26b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a264 expref: 16 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.885653:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788625123.885657:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:3636:x1875509206114816:12345-0@lo:103: 00010000:00010000:3.0:1788625123.885663:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625123.885671:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887c995a00/0x2d2e3b3f34a7a26b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a264 expref: 16 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.885677:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887c995a00/0x2d2e3b3f34a7a26b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a264 expref: 16 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.885686:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c995a00/0x2d2e3b3f34a7a26b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a264 expref: 16 pid: 6506 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.885692:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625123.885718:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:3636:x1875509206114816:12345-0@lo:103: Request processed in 60us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625123.885723:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788625123.885739:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206114816:0@lo:103: 00000100:00100000:1.0:1788625123.887296:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625123.887401:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185090176 00000100:00100000:3.0:1788625123.887408:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185090176 00010000:00010000:3.0:1788625123.887439:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a2aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df25 expref: 10 pid: 6506 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625123.887474:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 33 00000100:00100000:3.0:1788625123.887483:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2393:x1875509185090176:12345-192.168.204.14@tcp:103: 00010000:00010000:3.0:1788625123.887496:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625123.887501:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a2aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df25 expref: 10 pid: 6506 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.887513:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a2aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df25 expref: 10 pid: 6506 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.887562:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625123.887612:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2393:x1875509185090176:12345-192.168.204.14@tcp:103: Request processed in 130us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625123.887633:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 33 00010000:00010000:2.0:1788625123.888218:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a2aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df25 expref: 9 pid: 6506 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625123.888233:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206112384:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625123.890340:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844937480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875509206112512:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625123.890418:0:10324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7a2e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625123.892288:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625123.892359:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185090304 00000100:00100000:2.0:1788625123.892369:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185090304 00010000:00010000:2.0:1788625123.892405:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887c994800/0x2d2e3b3f34a7a2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df1e expref: 9 pid: 6505 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625123.892445:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 34 00000100:00100000:2.0:1788625123.892455:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:2394:x1875509185090304:12345-192.168.204.14@tcp:103: 00010000:00010000:2.0:1788625123.892470:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625123.892475:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887c994800/0x2d2e3b3f34a7a2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df1e expref: 9 pid: 6505 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.892488:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887c994800/0x2d2e3b3f34a7a2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df1e expref: 9 pid: 6505 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.892505:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c994800/0x2d2e3b3f34a7a2a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df1e expref: 9 pid: 6505 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.892623:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7a2e9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.892651:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7a2e9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.892674:0:10331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7a2e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.892682:0:10331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7a2e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.892688:0:10331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7a2e9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.892696:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7a2e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.892702:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625123.892706:0:10331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7a2e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.892714:0:10331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7a2e9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.892729:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7a2e9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625123.892739:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625123.892800:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+8:2394:x1875509185090304:12345-192.168.204.14@tcp:103: Request processed in 346us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625123.892809:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 34 00010000:00010000:3.0:1788625123.892927:0:10324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7a2e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.892937:0:10324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7a2e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625123.892943:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7a2e9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625124.353570:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625124.353609:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625124.353629:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625124.353650:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625124.353670:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625124.353697:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185090944 00000100:00100000:3.0:1788625124.353706:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185090944 00000100:00100000:3.0:1788625124.353777:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185090816 00000100:00100000:3.0:1788625124.353782:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185090816 00000100:00100000:2.0:1788625124.353945:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185090688 00000100:00100000:2.0:1788625124.353961:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185090688 00000100:00100000:2.0:1788625124.354010:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185090560 00000100:00100000:2.0:1788625124.354014:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185090560 00000100:00100000:2.0:1788625124.354036:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:2.0:1788625124.354045:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185090688:12345-192.168.204.14@tcp:400: 00000100:00100000:2.0:1788625124.354460:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185090688:12345-192.168.204.14@tcp:400: Request processed in 414us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625124.354469:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:2.0:1788625124.354488:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:2.0:1788625124.354495:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185090560:12345-192.168.204.14@tcp:400: 00000100:00100000:2.0:1788625124.354548:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185090560:12345-192.168.204.14@tcp:400: Request processed in 53us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625124.354554:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:3.0:1788625124.355475:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:3.0:1788625124.355495:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185090944:12345-192.168.204.14@tcp:400: 00000100:00100000:3.0:1788625124.355570:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185090944:12345-192.168.204.14@tcp:400: Request processed in 83us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625124.355610:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:1.0:1788625124.355623:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185090816:12345-192.168.204.14@tcp:400: 00000100:00100000:1.0:1788625124.355652:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185090816:12345-192.168.204.14@tcp:400: Request processed in 34us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625124.355659:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00080000:1.0:1788625124.355789:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625124.355794:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625124.355797:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788625124.355799:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625124.355976:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185090432 00000100:00100000:0.0:1788625124.355995:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185090432 00000100:00100000:0.0:1788625124.356036:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 200 00000100:00100000:0.0:1788625124.356044:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+8:2393:x1875509185090432:12345-192.168.204.14@tcp:400: 00000100:00100000:0.0:1788625124.356088:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+8:2393:x1875509185090432:12345-192.168.204.14@tcp:400: Request processed in 44us (2529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625124.356095:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 200 00000100:00100000:3.0:1788625124.357012:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 19 00010000:00010000:0.0:1788625124.428890:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788625124.939668:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788625124.939677:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9988449c9000 from 48 10000000:01000000:1.0:1788625124.939683:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788625124.939760:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625124.939782:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625124.939794:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625124.939817:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206114944:0@lo:101: 00000100:00100000:1.0:1788625124.939886:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625124.939943:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c64cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625124.942172:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206114944 00000100:00100000:2.0:1788625124.942186:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206114944 00000100:00100000:2.0:1788625124.942382:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788625124.942401:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+15:6508:x1875509206114944:12345-0@lo:101: 00010000:00010000:2.0:1788625124.942418:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625124.942453:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887cac6600/0x2d2e3b3f34a7a2f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a2f0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625124.942488:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac6600/0x2d2e3b3f34a7a2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a2f0 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625124.942506:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887cac6600/0x2d2e3b3f34a7a2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a2f0 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625124.942555:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6600, rc 0) 00000100:00100000:2.0:1788625124.942669:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206114944:12345-0@lo:101: Request processed in 272us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625124.942677:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788625124.942786:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206114944:0@lo:101: 00010000:00010000:1.0:1788625124.942812:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625124.942821:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625124.942907:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206115072:0@lo:501: 00000100:00100000:1.0:1788625124.942944:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625124.952046:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625124.954833:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206115072 00000100:00100000:0.0:1788625124.954848:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206115072 00000100:00100000:0.0:1788625124.954909:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788625124.954920:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206115072:12345-0@lo:501: 00000100:00100000:0.0:1788625124.955115:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206115072:12345-0@lo:501: Request processed in 197us (12170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625124.955123:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788625124.955340:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206115072:0@lo:501: 00000100:00100000:1.0:1788625124.955390:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206115200:0@lo:503: 00000100:00100000:1.0:1788625124.955454:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625124.955488:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625124.955752:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206115200 00000100:00100000:0.0:1788625124.955757:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206115200 00000100:00100000:0.0:1788625124.955778:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788625124.955785:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206115200:12345-0@lo:503: 00000100:00100000:0.0:1788625124.955866:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206115200:12345-0@lo:503: Request processed in 81us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625124.955873:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788625124.956070:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206115200:0@lo:503: 00000100:00100000:1.0:1788625124.957050:0:10343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10343:1875509206115328:0@lo:502: 00000100:00100000:1.0:1788625124.957174:0:10343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625124.957212:0:10343:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c64840 going to sleep for 11 seconds 00000100:00100000:0.0:1788625124.957262:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206115328 00000100:00100000:0.0:1788625124.957268:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206115328 00000100:00100000:0.0:1788625124.957412:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788625124.957430:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:10343:x1875509206115328:12345-0@lo:502: 00000100:00100000:0.0:1788625124.957703:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:10343:x1875509206115328:12345-0@lo:502: Request processed in 283us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625124.957711:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788625124.957966:0:10343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10343:1875509206115328:0@lo:502: 00000100:00100000:1.0:1788625124.958019:0:10343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10343:1875509206115456:0@lo:502: 00000100:00100000:1.0:1788625124.958079:0:10343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625124.963155:0:10343:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c64840 going to sleep for 11 seconds 00000100:00100000:2.0:1788625124.966205:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206115456 00000100:00100000:2.0:1788625124.966221:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206115456 00000100:00100000:2.0:1788625124.966352:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788625124.966364:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:10343:x1875509206115456:12345-0@lo:502: 00000100:00100000:2.0:1788625124.966900:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:10343:x1875509206115456:12345-0@lo:502: Request processed in 537us (8819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625124.966908:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788625124.967274:0:10343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10343:1875509206115456:0@lo:502: 00000040:00080000:1.0:1788625124.967318:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788625124.967718:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788625124.967808:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788625124.967819:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625124.967832:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625124.967842:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788625124.967845:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788625124.967848:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788625124.967880:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625124.967888:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625124.967897:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625124.967931:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206115584:0@lo:101: 00000100:00100000:2.0:1788625124.967997:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625124.968036:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885235f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788625124.969242:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206115584 00000100:00100000:1.0:1788625124.969253:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206115584 00000100:00100000:1.0:1788625124.969364:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788625124.969375:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+16:6508:x1875509206115584:12345-0@lo:101: 00010000:00010000:1.0:1788625124.969390:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625124.969406:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998859be9000/0x2d2e3b3f34a7a305 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a2fe expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625124.969632:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998859be9000/0x2d2e3b3f34a7a305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a2fe expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625124.969643:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998859be9000/0x2d2e3b3f34a7a305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a2fe expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625124.969652:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be9000, rc 0) 00000100:00100000:1.0:1788625124.969714:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206115584:12345-0@lo:101: Request processed in 341us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625124.969720:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788625124.970644:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206115584:0@lo:101: 00010000:00010000:2.0:1788625124.970667:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a305 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625124.970678:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a305 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625124.970841:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206115712:0@lo:501: 00000100:00100000:2.0:1788625124.970883:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625124.971189:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206115712 00000100:00100000:0.0:1788625124.971196:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206115712 00000100:00100000:0.0:1788625124.971232:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788625124.971240:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206115712:12345-0@lo:501: 00000100:00100000:0.0:1788625124.971668:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206115712:12345-0@lo:501: Request processed in 429us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625124.971677:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788625124.971888:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885235f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788625124.971904:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206115712:0@lo:501: 00000100:00100000:2.0:1788625124.972375:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206115840:0@lo:503: 00000100:00100000:2.0:1788625124.973378:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625124.973414:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885235f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788625124.974189:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206115840 00000100:00100000:0.0:1788625124.974198:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206115840 00000100:00100000:0.0:1788625124.974250:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788625124.974260:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206115840:12345-0@lo:503: 00000100:00100000:0.0:1788625124.976347:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206115840:12345-0@lo:503: Request processed in 2080us (2962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625124.976360:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788625124.978229:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206115840:0@lo:503: 00000100:00100000:3.0:1788625124.980698:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10344:1875509206115968:0@lo:502: 00000100:00100000:3.0:1788625124.980926:0:10344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625124.980994:0:10344:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625124.981069:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206115968 00000100:00100000:1.0:1788625124.981082:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206115968 00000100:00100000:1.0:1788625124.981204:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788625124.981214:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:10344:x1875509206115968:12345-0@lo:502: 00000100:00100000:1.0:1788625124.981411:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:10344:x1875509206115968:12345-0@lo:502: Request processed in 199us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625124.981486:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788625124.982207:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10344:1875509206115968:0@lo:502: 00000020:01000000:3.0:1788625124.982239:0:10344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625124.982249:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625124.982251:0:10344:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788625124.982261:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788625124.982353:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10344:1875509206116096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625124.982400:0:10344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625124.982504:0:10344:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788625124.982617:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206116096 00000100:00100000:0.0:1788625124.982622:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206116096 00000100:00100000:0.0:1788625124.982666:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788625124.982674:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:10344:x1875509206116096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625124.982922:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:10344:x1875509206116096:12345-0@lo:502:llog_process_th.0 Request processed in 248us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625124.982929:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788625124.983077:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10344:1875509206116096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625124.983195:0:10344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625124.983201:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625124.983203:0:10344:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788625124.983206:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1788625124.995758:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788625124.995799:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788625124.995811:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a305 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625124.995824:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a305 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625124.995945:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788625124.995949:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998878127800 from 48 10000000:01000000:3.0:1788625124.995952:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788625124.996004:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625124.996012:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625124.996022:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625124.996048:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206116224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625124.996167:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625124.996216:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625124.996326:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206116224 00000100:00100000:1.0:1788625124.996336:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206116224 00000100:00100000:1.0:1788625124.996390:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788625124.996400:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+17:6508:x1875509206116224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625124.996412:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625124.996437:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998859be8000/0x2d2e3b3f34a7a313 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a30c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625124.996461:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998859be8000/0x2d2e3b3f34a7a313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a30c expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625124.996471:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998859be8000/0x2d2e3b3f34a7a313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a30c expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625124.996480:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be8000, rc 0) 00000100:00100000:1.0:1788625124.996544:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206116224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625124.996567:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788625124.997118:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206116224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625124.997164:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a313 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625124.997185:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a313 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625124.997320:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206116352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625124.997373:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625124.997409:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625124.997883:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206116352 00000100:00100000:0.0:1788625124.997889:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206116352 00000100:00100000:0.0:1788625124.997927:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788625124.997942:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206116352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625124.998081:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206116352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625124.998088:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788625124.998596:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206116352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625124.998633:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206116480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625124.998690:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625124.998718:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625125.001111:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206116480 00000100:00100000:0.0:1788625125.001123:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206116480 00000100:00100000:0.0:1788625125.001182:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788625125.001192:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206116480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625125.001356:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206116480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (2664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625125.001364:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788625125.001954:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206116480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625125.002611:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10345:1875509206116608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625125.002676:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.002719:0:10345:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788625125.003037:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206116608 00000100:00100000:2.0:1788625125.003043:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206116608 00000100:00100000:2.0:1788625125.003086:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788625125.003104:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:10345:x1875509206116608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625125.003218:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:10345:x1875509206116608:12345-0@lo:502:llog_process_th.0 Request processed in 124us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625125.003225:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788625125.003567:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10345:1875509206116608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625125.003611:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10345:1875509206116736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625125.003655:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.003683:0:10345:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788625125.003756:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206116736 00000100:00100000:1.0:1788625125.003761:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206116736 00000100:00100000:1.0:1788625125.003787:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788625125.003794:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:10345:x1875509206116736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625125.003882:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:10345:x1875509206116736:12345-0@lo:502:llog_process_th.0 Request processed in 87us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625125.003888:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788625125.004089:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10345:1875509206116736:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788625125.004120:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788625125.004433:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788625125.004454:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788625125.004464:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a313 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.004475:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a313 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625125.004484:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788625125.004487:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788625125.004490:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788625125.004514:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.004556:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.004565:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625125.004581:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206116864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788625125.004620:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625125.004640:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c640c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625125.004787:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206116864 00000100:00100000:0.0:1788625125.004792:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206116864 00000100:00100000:0.0:1788625125.004812:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788625125.004817:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+18:6508:x1875509206116864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625125.004825:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625125.004836:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c995400/0x2d2e3b3f34a7a321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a31a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625125.004855:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c995400/0x2d2e3b3f34a7a321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a31a expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625125.004862:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c995400/0x2d2e3b3f34a7a321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a31a expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625125.004868:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995400, rc 0) 00000100:00100000:0.0:1788625125.004908:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:6508:x1875509206116864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625125.004917:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788625125.007072:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206116864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625125.007104:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.007117:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625125.007196:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206116992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625125.007245:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625125.007282:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625125.008161:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206116992 00000100:00100000:1.0:1788625125.008169:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206116992 00000100:00100000:1.0:1788625125.008229:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788625125.008238:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:6508:x1875509206116992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625125.008682:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:6508:x1875509206116992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 443us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625125.008690:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788625125.009621:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206116992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625125.010551:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206117120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625125.010618:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625125.010673:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206117120 00000100:00100000:2.0:1788625125.010678:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885235f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788625125.010680:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206117120 00000100:00100000:1.0:1788625125.010717:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788625125.010946:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:6508:x1875509206117120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625125.011491:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:6508:x1875509206117120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 765us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625125.011499:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788625125.011631:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206117120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625125.012098:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10346:1875509206117248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625125.012138:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625125.012173:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885235fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625125.012280:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206117248 00000100:00100000:1.0:1788625125.012285:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206117248 00000100:00100000:1.0:1788625125.012327:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788625125.012335:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:10346:x1875509206117248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625125.012428:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:10346:x1875509206117248:12345-0@lo:502:llog_process_th.0 Request processed in 93us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625125.012435:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788625125.012578:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10346:1875509206117248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788625125.012602:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625125.012612:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625125.012614:0:10346:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788625125.012619:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788625125.012638:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10346:1875509206117376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625125.012670:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625125.012688:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c4de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625125.012858:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206117376 00000100:00100000:1.0:1788625125.012863:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206117376 00000100:00100000:1.0:1788625125.012926:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788625125.012934:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:10346:x1875509206117376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625125.013019:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:10346:x1875509206117376:12345-0@lo:502:llog_process_th.0 Request processed in 86us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625125.013026:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788625125.013085:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10346:1875509206117376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788625125.013109:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625125.013114:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625125.013115:0:10346:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788625125.013119:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1788625125.015417:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788625125.015469:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788625125.015480:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625125.015494:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625125.015542:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788625125.015545:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99886c323000 from 48 10000000:01000000:3.0:1788625125.015548:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788625125.015582:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625125.015591:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625125.015603:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625125.015627:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206117504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625125.015841:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625125.019725:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206117504 00000100:00100000:3.0:1788625125.019747:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625125.019803:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206117504 00000100:00100000:0.0:1788625125.019855:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788625125.019863:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:6508:x1875509206117504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625125.019877:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625125.019895:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c994a00/0x2d2e3b3f34a7a32f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a328 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625125.019923:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c994a00/0x2d2e3b3f34a7a32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a328 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625125.019935:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c994a00/0x2d2e3b3f34a7a32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a328 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625125.019944:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994a00, rc 0) 00000100:00100000:0.0:1788625125.020028:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206117504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (4186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625125.020035:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788625125.020085:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206117504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625125.020114:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a32f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625125.020124:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a32f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625125.020192:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206117632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625125.020222:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.020246:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625125.020282:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206117632 00000100:00100000:0.0:1788625125.020287:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206117632 00000100:00100000:0.0:1788625125.020500:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788625125.020507:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206117632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625125.020674:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206117632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625125.020680:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788625125.027460:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206117632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625125.027552:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206117760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625125.027634:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.027683:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788625125.027705:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206117760 00000100:00100000:2.0:1788625125.027713:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206117760 00000100:00100000:2.0:1788625125.027769:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788625125.027779:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206117760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625125.027901:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206117760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625125.027909:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788625125.028173:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206117760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625125.029166:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10347:1875509206117888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625125.029224:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.029264:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625125.029435:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206117888 00000100:00100000:1.0:1788625125.029442:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206117888 00000100:00100000:1.0:1788625125.029484:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788625125.029492:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:10347:x1875509206117888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625125.029625:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:10347:x1875509206117888:12345-0@lo:502:llog_process_th.0 Request processed in 134us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625125.029632:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788625125.029737:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10347:1875509206117888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625125.029852:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10347:1875509206118016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625125.029886:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.029915:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625125.030006:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206118016 00000100:00100000:0.0:1788625125.030017:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206118016 00000100:00100000:2.0:1788625125.030056:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788625125.030070:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:10347:x1875509206118016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625125.030150:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:10347:x1875509206118016:12345-0@lo:502:llog_process_th.0 Request processed in 86us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625125.030207:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10347:1875509206118016:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788625125.030228:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788625125.030432:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788625125.030451:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788625125.030461:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a32f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.030471:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a32f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625125.030488:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788625125.030491:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1788625125.030494:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788625125.030536:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.030543:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.030552:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625125.030565:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206118144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788625125.030593:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625125.030613:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206118144 00000100:00100000:1.0:1788625125.030616:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206118144 00000100:00100000:2.0:1788625125.035136:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788625125.035154:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c64d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625125.036804:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788625125.036826:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206118144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625125.036844:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625125.036865:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998859be9a00/0x2d2e3b3f34a7a33d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a336 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.036897:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998859be9a00/0x2d2e3b3f34a7a33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a336 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.036909:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998859be9a00/0x2d2e3b3f34a7a33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a336 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.036941:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be9a00, rc 0) 00000100:00100000:1.0:1788625125.037043:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206118144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (6449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625125.037049:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788625125.037214:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206118144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625125.037237:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a33d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625125.037248:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a33d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625125.037455:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206118272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625125.037491:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.037574:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788625125.037658:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206118272 00000100:00100000:1.0:1788625125.037665:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206118272 00000100:00100000:1.0:1788625125.037753:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788625125.037762:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206118272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625125.037899:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206118272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625125.037906:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788625125.037978:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206118272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625125.038009:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206118400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625125.038057:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.042510:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788625125.044998:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206118400 00000100:00100000:2.0:1788625125.045015:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206118400 00000100:00100000:2.0:1788625125.045076:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788625125.045087:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206118400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625125.045276:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206118400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (7218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625125.045284:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788625125.045478:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206118400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625125.046094:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10348:1875509206118528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625125.046364:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.046583:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788625125.046814:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206118528 00000100:00100000:0.0:1788625125.046820:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206118528 00000100:00100000:0.0:1788625125.046861:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788625125.046869:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:10348:x1875509206118528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625125.046992:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:10348:x1875509206118528:12345-0@lo:502:llog_process_th.0 Request processed in 123us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625125.046999:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788625125.047121:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10348:1875509206118528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788625125.047146:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625125.047155:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625125.047157:0:10348:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788625125.047167:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788625125.047189:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10348:1875509206118656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625125.047222:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.047293:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625125.047730:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206118656 00000100:00100000:2.0:1788625125.047737:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206118656 00000100:00100000:3.0:1788625125.047894:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788625125.047900:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:10348:x1875509206118656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625125.048008:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:10348:x1875509206118656:12345-0@lo:502:llog_process_th.0 Request processed in 107us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625125.048015:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788625125.048103:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10348:1875509206118656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625125.048125:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625125.048130:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625125.048131:0:10348:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788625125.048135:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1788625125.048279:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1788625125.048301:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788625125.048309:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a33d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625125.048320:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a33d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625125.048341:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788625125.048344:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998852348000 from 48 10000000:01000000:3.0:1788625125.048347:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788625125.048370:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625125.048378:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625125.048387:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625125.048403:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206118784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625125.048434:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.048551:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625125.049455:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206118784 00000100:00100000:1.0:1788625125.049462:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206118784 00000100:00100000:1.0:1788625125.049509:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788625125.049585:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206118784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625125.049597:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625125.049611:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a34b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a344 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.049828:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a344 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.049854:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a344 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.049864:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be9c00, rc 0) 00000100:00100000:1.0:1788625125.049920:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206118784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 403us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625125.049927:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788625125.050069:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206118784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625125.050085:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a34b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625125.050093:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a34b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625125.050160:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206118912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625125.050190:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.050225:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625125.050363:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206118912 00000100:00100000:2.0:1788625125.050369:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206118912 00000100:00100000:2.0:1788625125.050409:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788625125.050417:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206118912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625125.050552:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206118912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625125.050559:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788625125.051245:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206118912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625125.051281:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206119040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625125.051330:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.051364:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625125.051366:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206119040 00000100:00100000:2.0:1788625125.051370:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206119040 00000100:00100000:2.0:1788625125.051410:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788625125.051418:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206119040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625125.051511:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206119040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625125.051539:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788625125.054032:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206119040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625125.054713:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10349:1875509206119168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625125.054800:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.054843:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788625125.054890:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206119168 00000100:00100000:2.0:1788625125.054897:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206119168 00000100:00100000:2.0:1788625125.054950:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788625125.054959:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:10349:x1875509206119168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625125.055091:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:10349:x1875509206119168:12345-0@lo:502:llog_process_th.0 Request processed in 132us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625125.055100:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788625125.055569:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10349:1875509206119168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625125.055618:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10349:1875509206119296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625125.055656:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.055682:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788625125.056029:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206119296 00000100:00100000:2.0:1788625125.056034:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206119296 00000100:00100000:2.0:1788625125.056069:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788625125.056076:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:10349:x1875509206119296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625125.056441:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:10349:x1875509206119296:12345-0@lo:502:llog_process_th.0 Request processed in 365us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625125.056449:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788625125.056629:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10349:1875509206119296:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788625125.056653:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788625125.065612:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788625125.065662:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788625125.065675:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a34b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.065689:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a34b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625125.065716:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788625125.065719:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1788625125.065722:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788625125.065830:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.065840:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.065849:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625125.065873:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206119424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788625125.065953:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625125.066009:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c64f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625125.066039:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206119424 00000100:00100000:0.0:1788625125.066047:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206119424 00000100:00100000:0.0:1788625125.066114:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788625125.066125:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206119424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625125.066138:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625125.066151:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c994200/0x2d2e3b3f34a7a359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a352 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625125.066183:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c994200/0x2d2e3b3f34a7a359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a352 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625125.066194:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c994200/0x2d2e3b3f34a7a359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a352 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625125.066202:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994200, rc 0) 00000100:00100000:0.0:1788625125.066259:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206119424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625125.066266:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788625125.066301:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206119424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625125.066318:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a359 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625125.066327:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a359 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625125.066381:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206119552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625125.066407:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625125.066437:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625125.066682:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206119552 00000100:00100000:0.0:1788625125.066687:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206119552 00000100:00100000:0.0:1788625125.066725:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788625125.066732:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206119552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625125.066854:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206119552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625125.066861:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788625125.067548:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206119552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625125.067590:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206119680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625125.067644:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625125.067676:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625125.067724:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206119680 00000100:00100000:0.0:1788625125.067730:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206119680 00000100:00100000:0.0:1788625125.067764:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788625125.067772:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206119680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625125.067871:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206119680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625125.067878:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788625125.067944:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206119680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625125.070934:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10350:1875509206119808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625125.071025:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625125.071069:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788625125.071246:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206119808 00000100:00100000:1.0:1788625125.071254:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206119808 00000100:00100000:1.0:1788625125.071376:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788625125.071387:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:10350:x1875509206119808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625125.071595:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10350:1875509206119808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788625125.071624:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625125.071633:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625125.071636:0:10350:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788625125.071641:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788625125.071660:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10350:1875509206119936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625125.071693:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625125.071724:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788625125.071776:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206119936 00000100:00100000:0.0:1788625125.071781:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206119936 00000100:00100000:0.0:1788625125.071813:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788625125.071821:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:10350:x1875509206119936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625125.071903:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:10350:x1875509206119936:12345-0@lo:502:llog_process_th.0 Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625125.071911:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788625125.071940:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10350:1875509206119936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788625125.071961:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625125.071965:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625125.071967:0:10350:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788625125.071982:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788625125.072056:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788625125.072075:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788625125.072084:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a359 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625125.072094:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a359 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625125.072122:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788625125.072125:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99885ecd99c0 from 1 10000000:01000000:0.0:1788625125.072128:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788625125.072151:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625125.072159:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625125.072168:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625125.072191:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206120064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625125.072220:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625125.072242:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b4773c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625125.072356:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206120064 00000100:00100000:2.0:1788625125.072360:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206120064 00000100:00100000:2.0:1788625125.072392:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788625125.072398:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206120064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625125.072406:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625125.072418:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887cac6c00/0x2d2e3b3f34a7a367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a360 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625125.072439:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac6c00/0x2d2e3b3f34a7a367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a360 expref: 25 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625125.072448:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887cac6c00/0x2d2e3b3f34a7a367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a360 expref: 25 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625125.072457:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6c00, rc 0) 00000100:00100000:2.0:1788625125.072491:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+25:6508:x1875509206120064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625125.072498:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788625125.072570:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206120064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625125.072581:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a367 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625125.072595:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a367 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625125.072644:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:10350:x1875509206119808:12345-0@lo:502:llog_process_th.0 Request processed in 132us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625125.072648:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206120192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625125.072652:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788625125.072669:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625125.072688:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625125.072698:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206120192 00000100:00100000:2.0:1788625125.072701:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206120192 00000100:00100000:2.0:1788625125.072716:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788625125.072721:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206120192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625125.072784:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206120192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (114us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625125.072802:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788625125.073383:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206120192:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788625125.073406:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788625125.073412:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a367 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625125.073419:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a367 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625125.132724:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625125.132748:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206120320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625125.132819:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625125.132956:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206120320 00000100:00100000:0.0:1788625125.132964:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206120320 00000100:00100000:0.0:1788625125.133024:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788625125.133034:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206120320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625125.133078:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788625125.133120:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206120320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625125.133126:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788625125.133251:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206120320:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788625125.452363:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625125.644160:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625125.644191:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206120448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625125.644257:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625125.644396:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206120576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625125.644425:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625125.644511:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206120448 00000100:00100000:2.0:1788625125.644654:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206120448 00000100:00100000:2.0:1788625125.644714:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206120576 00000100:00100000:2.0:1788625125.644718:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206120576 00000100:00100000:2.0:1788625125.644736:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788625125.644745:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206120448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788625125.644773:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625125.644820:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206120448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625125.644828:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788625125.644847:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788625125.644894:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788625125.644923:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439fc380 x1875509206120448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625125.644939:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206120448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625125.644992:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206120576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625125.645006:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625125.645066:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206120576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (640us total) trans 0 rc 0/0 00010000:00080000:3.0:1788625125.646330:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439f3800 x1875509206120576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625125.646369:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206120576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625125.651854:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788625126.155961:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206120832:0@lo:400:kworker.0 00000100:00100000:0.0:1788625126.156047:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625126.156103:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206121344:0@lo:400:kworker.0 00000100:00100000:2.0:1788625126.156115:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206120832 00000100:00100000:2.0:1788625126.156125:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206120832 00000100:00100000:0.0:1788625126.156130:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625126.156169:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206121856:0@lo:400:kworker.0 00000100:00100000:2.0:1788625126.156173:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206121344 00000100:00100000:2.0:1788625126.156177:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206121344 00000100:00100000:0.0:1788625126.156196:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625126.156221:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788625126.156227:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206120960:0@lo:400:kworker.0 00000100:00100000:0.0:1788625126.156250:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625126.156267:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206121472:0@lo:400:kworker.0 00000100:00100000:0.0:1788625126.156296:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625126.156307:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206121984:0@lo:400:kworker.0 00000100:00100000:0.0:1788625126.156326:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625126.156346:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206120960 00000100:00100000:0.0:1788625126.156350:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206120960 00000100:00100000:0.0:1788625126.156377:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788625126.156386:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206120960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625126.156452:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206120960:12345-0@lo:400:kworker.0 Request processed in 67us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625126.156460:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788625126.156499:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206121856 00000100:00100000:2.0:1788625126.156502:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206121856 00000100:00080000:3.0:1788625126.156534:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625126.156553:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206121472 00000100:00100000:3.0:1788625126.156557:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206121472 00000100:00100000:3.0:1788625126.156586:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206121984 00000100:00100000:3.0:1788625126.156589:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206121984 00000100:00100000:0.0:1788625126.156604:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206120960:0@lo:400:kworker.0 00000100:00100000:3.0:1788625126.156609:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788625126.156619:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206120832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625126.156650:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788625126.156670:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206120832:12345-0@lo:400:kworker.0 Request processed in 51us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625126.156675:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206121344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625126.156684:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788625126.156703:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788625126.156712:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206121472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625126.156719:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206121344:12345-0@lo:400:kworker.0 Request processed in 48us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625126.156727:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788625126.156732:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206120704:0@lo:400:kworker.0 00000100:00100000:0.0:1788625126.156749:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788625126.156756:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206121472:12345-0@lo:400:kworker.0 Request processed in 46us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625126.156761:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206121984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625126.156769:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788625126.156775:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788625126.156780:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788625126.156795:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625126.156810:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206121984:12345-0@lo:400:kworker.0 Request processed in 52us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625126.156817:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788625126.156821:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206121216:0@lo:400:kworker.0 00010000:00080000:3.0:1788625126.156824:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439f2680 x1875509206121472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625126.156842:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206121472:0@lo:400:kworker.0 00000100:00100000:0.0:1788625126.156847:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206121088:0@lo:400:kworker.0 00010000:00080000:3.0:1788625126.156863:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439f1180 x1875509206121984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625126.156870:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625126.156881:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206121984:0@lo:400:kworker.0 00000100:00100000:0.0:1788625126.156886:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625126.156898:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206120832:0@lo:400:kworker.0 00000100:00100000:0.0:1788625126.156912:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206121600:0@lo:400:kworker.0 00000100:00100000:3.0:1788625126.156923:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206121344:0@lo:400:kworker.0 00000100:00100000:0.0:1788625126.156941:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625126.156964:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206121088 00000100:00100000:1.0:1788625126.156966:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206121728:0@lo:400:kworker.0 00000100:00100000:3.0:1788625126.156969:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206121088 00000100:00100000:0.0:1788625126.156978:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206122112:0@lo:400:kworker.0 00000100:00100000:2.0:1788625126.157007:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206121856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625126.157007:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625126.157018:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206121216 00000100:00100000:0.0:1788625126.157025:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206121216 00000100:00100000:1.0:1788625126.157039:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206122240:0@lo:400:kworker.0 00000100:00100000:3.0:1788625126.157054:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788625126.157056:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788625126.157063:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206121856:12345-0@lo:400:kworker.0 Request processed in 272us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625126.157064:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206121088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625126.157071:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206121216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625126.157076:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788625126.157105:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206120704 00000100:00100000:2.0:1788625126.157109:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206120704 00000100:00100000:2.0:1788625126.157134:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788625126.157140:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206120704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625126.157289:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625126.157302:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206121088:12345-0@lo:400:kworker.0 Request processed in 238us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625126.157309:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788625126.157333:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206121600 00000100:00100000:1.0:1788625126.157339:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206121600 00000100:00100000:3.0:1788625126.157344:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206121856:0@lo:400:kworker.0 00000100:00100000:1.0:1788625126.157378:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206121728 00000100:00100000:3.0:1788625126.157379:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206122240 00000100:00100000:3.0:1788625126.157384:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206122240 00000100:00100000:1.0:1788625126.157384:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206121728 00000100:00100000:1.0:1788625126.157406:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788625126.157413:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206121600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625126.157446:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206121600:12345-0@lo:400:kworker.0 Request processed in 34us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625126.157570:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788625126.157577:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206121728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625126.157616:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206121728:12345-0@lo:400:kworker.0 Request processed in 41us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625126.157623:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788625126.157635:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788625126.157641:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206122240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625126.157669:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206122240:12345-0@lo:400:kworker.0 Request processed in 28us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625126.157675:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788625126.157692:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625126.157704:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206121216:12345-0@lo:400:kworker.0 Request processed in 638us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625126.157712:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788625126.157802:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625126.157835:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206121216:0@lo:400:kworker.0 00000100:00100000:3.0:1788625126.157842:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206121088:0@lo:400:kworker.0 00010000:00080000:0.0:1788625126.157855:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439f2a00 x1875509206121728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788625126.157862:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439f0380 x1875509206121600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625126.157903:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206121728:0@lo:400:kworker.0 00000100:00100000:3.0:1788625126.157904:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206121600:0@lo:400:kworker.0 00010000:00080000:0.0:1788625126.157929:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742e43800 x1875509206122240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625126.157935:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206122112 00000100:00100000:3.0:1788625126.157940:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206122112 00000100:00100000:0.0:1788625126.157943:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206122240:0@lo:400:kworker.0 00000100:00100000:3.0:1788625126.158106:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788625126.158114:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206122112:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788625126.158119:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625126.158165:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206122112:12345-0@lo:400:kworker.0 Request processed in 53us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625126.158171:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788625126.158482:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206120704:12345-0@lo:400:kworker.0 Request processed in 1340us (1702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625126.158491:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788625126.158590:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206120704:0@lo:400:kworker.0 00000100:00100000:1.0:1788625126.159711:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788625126.161153:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439f1500 x1875509206122112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625126.161170:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206122112:0@lo:400:kworker.0 00010000:00010000:3.0:1788625126.477018:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625126.667770:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206122368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625126.667854:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625126.667920:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625126.667927:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206122496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625126.667964:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625126.668005:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206122496 00000100:00100000:3.0:1788625126.668013:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206122496 00000100:00100000:3.0:1788625126.668059:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788625126.668068:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206122496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788625126.668098:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625126.668160:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206122496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625126.668168:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788625126.668205:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887cb11f80 x1875509206122496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625126.668241:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206122496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625126.668396:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206122368 00000100:00100000:2.0:1788625126.668400:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206122368 00000100:00100000:2.0:1788625126.668431:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788625126.668438:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206122368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788625126.668461:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788625126.668543:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206122368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625126.668551:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788625126.668581:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625126.668591:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206122624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625126.668617:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625126.668642:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206122624 00000100:00100000:2.0:1788625126.668646:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206122624 00000100:00100000:2.0:1788625126.668666:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625126.668672:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206122624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788625126.668682:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625126.668721:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206122624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625126.668727:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788625126.668752:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bd180 x1875509206122624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625126.668765:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206122624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625126.668791:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206122368:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788625127.502168:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625128.524057:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625128.960349:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625128.960562:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185091072 00000100:00100000:0.0:1788625128.960572:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185091072 00000100:00100000:0.0:1788625128.960641:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 244 00000100:00100000:0.0:1788625128.960662:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+8:6164:x1875509185091072:12345-192.168.204.14@tcp:101: 00010000:00010000:0.0:1788625128.960679:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625128.960698:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c995a00/0x2d2e3b3f34a7a36e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3df95 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625128.960731:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c995a00/0x2d2e3b3f34a7a36e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df95 expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625128.960743:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c995a00/0x2d2e3b3f34a7a36e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df95 expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625128.960752:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995a00, rc 0) 00000100:00100000:0.0:1788625128.960813:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:6164:x1875509185091072:12345-192.168.204.14@tcp:101: Request processed in 163us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625128.960834:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 244 00000100:00100000:0.0:1788625128.967301:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625128.967459:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185091200 00000100:00100000:2.0:1788625128.967469:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185091200 00000100:00100000:2.0:1788625128.967551:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 245 00000100:00100000:2.0:1788625128.967562:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:6164:x1875509185091200:12345-192.168.204.14@tcp:501: 00000100:00100000:2.0:1788625128.967742:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:6164:x1875509185091200:12345-192.168.204.14@tcp:501: Request processed in 180us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625128.967751:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 245 00000100:00100000:1.0:1788625128.971619:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625128.971876:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185091328 00000100:00100000:2.0:1788625128.971887:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185091328 00000100:00100000:2.0:1788625128.972090:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 246 00000100:00100000:2.0:1788625128.972102:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:6164:x1875509185091328:12345-192.168.204.14@tcp:503: 00000100:00100000:2.0:1788625128.972262:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:6164:x1875509185091328:12345-192.168.204.14@tcp:503: Request processed in 161us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625128.981437:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 246 00000100:00100000:1.0:1788625128.983754:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625128.984299:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185091456 00000100:00100000:0.0:1788625128.984310:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185091456 00000100:00100000:0.0:1788625128.984382:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 247 00000100:00100000:0.0:1788625128.984393:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:6662:x1875509185091456:12345-192.168.204.14@tcp:502: 00000100:00100000:1.0:1788625128.985819:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:6662:x1875509185091456:12345-192.168.204.14@tcp:502: Request processed in 1424us (2070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625128.985830:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 247 00000100:00100000:3.0:1788625128.998761:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625129.002760:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185091584 00000100:00100000:2.0:1788625129.002777:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185091584 00000100:00100000:2.0:1788625129.004379:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 248 00000100:00100000:2.0:1788625129.004414:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:6662:x1875509185091584:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788625129.004617:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:6662:x1875509185091584:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 209us (5864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625129.004636:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 248 00000100:00100000:0.0:1788625129.013947:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625129.014988:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185091712 00000100:00100000:1.0:1788625129.015002:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185091712 00000100:00100000:1.0:1788625129.015068:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 249 00000100:00100000:1.0:1788625129.015079:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:6164:x1875509185091712:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625129.015262:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625129.015281:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998859be8200/0x2d2e3b3f34a7a375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3df9c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625129.015328:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998859be8200/0x2d2e3b3f34a7a375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df9c expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625129.015340:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998859be8200/0x2d2e3b3f34a7a375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df9c expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625129.015350:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be8200, rc 0) 00000100:00100000:1.0:1788625129.018312:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6164:x1875509185091712:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 Request processed in 3224us (4363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625129.018325:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 249 00000100:00100000:1.0:1788625129.026218:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625129.026723:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185091840 00000100:00100000:2.0:1788625129.026734:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185091840 00000100:00100000:2.0:1788625129.026795:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 250 00000100:00100000:2.0:1788625129.026804:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6164:x1875509185091840:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625129.027062:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6164:x1875509185091840:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 Request processed in 258us (861us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625129.027070:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 250 00000100:00100000:0.0:1788625129.469684:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625129.469726:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625129.469754:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625129.469784:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625129.469808:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625129.469834:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185092480 00000100:00100000:0.0:1788625129.469843:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185092480 00000100:00100000:0.0:1788625129.469916:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185092352 00000100:00100000:0.0:1788625129.469919:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185092352 00000100:00100000:2.0:1788625129.469934:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185092224 00000100:00100000:2.0:1788625129.469941:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185092224 00000100:00100000:0.0:1788625129.469965:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:2.0:1788625129.469979:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185092096 00000100:00100000:0.0:1788625129.469979:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185092480:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625129.469985:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185092096 00000100:00100000:2.0:1788625129.470012:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 72 00000100:00100000:2.0:1788625129.470022:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185092224:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625129.470062:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185092480:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 87us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625129.470066:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185092224:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 43us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625129.470075:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:2.0:1788625129.470080:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 72 00000100:00100000:0.0:1788625129.470103:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 26 00000100:00100000:2.0:1788625129.470109:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 73 00000100:00100000:2.0:1788625129.470118:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185092096:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625129.470126:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185092352:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625129.470150:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185092096:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 31us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625129.470157:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 73 00000100:00100000:0.0:1788625129.470183:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185092352:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 60us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625129.470200:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 26 00000100:00080000:2.0:1788625129.470206:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788625129.470212:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788625129.470215:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788625129.470218:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625129.470637:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185091968 00000100:00100000:1.0:1788625129.470641:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185091968 00000100:00100000:1.0:1788625129.470677:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 251 00000100:00100000:1.0:1788625129.470684:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2394:x1875509185091968:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625129.470712:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2394:x1875509185091968:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 29us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625129.470719:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 251 00010000:00010000:3.0:1788625129.548059:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625130.251786:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625130.251808:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206122752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625130.251889:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625130.252028:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206122752 00000100:00100000:2.0:1788625130.252043:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206122752 00000100:00100000:2.0:1788625130.252278:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788625130.252304:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206122752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788625130.252354:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788625130.252449:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206122752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 159us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625130.252456:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788625130.252559:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206122752:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1788625130.511485:0:10388:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd14a6bd70 20000000:00000080:1.0:1788625130.511510:0:10388:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99887f8d2000 uarg=0000000000000000 20000000:01000000:1.0:1788625130.511591:0:10388:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788625130.511600:0:10388:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788625130.511606:0:10388:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788625130.512473:0:10389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788625130.512745:0:10388:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788625130.519232:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788625130.519284:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788625130.519305:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788625130.519334:0:10388:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788625130.519360:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a37c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.519382:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887cac7e00/0x2d2e3b3f34a7a018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a011 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.519393:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998859be9600/0x2d2e3b3f34a7a026 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a01f expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.519401:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7a07a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a073 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.519407:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a1a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a199 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.519419:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887b683a00/0x2d2e3b3f34a7a2b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df5d expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.519428:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a37c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.519500:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887b683a00/0x2d2e3b3f34a7a2b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df5d expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.519682:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99887b683a00/0x2d2e3b3f34a7a2b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df5d expref: 9 pid: 6506 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625130.519703:0:10388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875509206122880:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625130.519855:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a1a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a199 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.519876:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a1a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a199 expref: 23 pid: 6505 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625130.519886:0:10388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875509206123008:0@lo:104: 00000100:00100000:3.0:1788625130.519949:0:10388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625130.519992:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7a07a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a073 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.520000:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7a07a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a073 expref: 23 pid: 6506 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625130.520009:0:10388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875509206123136:0@lo:104: 00000100:00100000:3.0:1788625130.520035:0:10388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625130.520079:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788625130.520106:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206123008 00000100:00100000:3.0:1788625130.520115:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206123008 00000100:00100000:3.0:1788625130.520166:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206123136 00000100:00100000:3.0:1788625130.520169:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206123136 00000100:00100000:3.0:1788625130.520199:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788625130.520209:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:10388:x1875509206123008:12345-0@lo:104: 00010000:00010000:3.0:1788625130.520224:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7a199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a1a0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.520283:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625130.520289:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:10388:x1875509206123008:12345-0@lo:104: Request processed in 82us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625130.520297:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788625130.520317:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788625130.520324:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:10388:x1875509206123136:12345-0@lo:104: 00010000:00010000:3.0:1788625130.520333:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887c995600/0x2d2e3b3f34a7a073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a07a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.520367:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788625130.520372:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:10388:x1875509206123136:12345-0@lo:104: Request processed in 49us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625130.520378:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1788625130.520423:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625130.520430:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7a199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a1a0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.520439:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9200 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625130.520444:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7a199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a1a0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.520454:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7a199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a1a0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625130.520473:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7a199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a1a0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625130.520479:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788625130.520511:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7a199 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a1a0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.520562:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625130.520587:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7a199 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a1a0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.520595:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7a199 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a1a0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.520613:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625130.520616:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887c995600/0x2d2e3b3f34a7a073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a07a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.520623:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995600 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625130.520626:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887c995600/0x2d2e3b3f34a7a073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a07a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.520632:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887c995600/0x2d2e3b3f34a7a073 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a07a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625130.520638:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887c995600/0x2d2e3b3f34a7a073 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a07a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625130.520643:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788625130.520665:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887c995600/0x2d2e3b3f34a7a073 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a07a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.520672:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625130.520679:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887c995600/0x2d2e3b3f34a7a073 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a07a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.520685:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887c995600/0x2d2e3b3f34a7a073 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a07a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.520695:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625130.520697:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625130.520699:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625130.520715:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206123264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625130.520749:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625130.520778:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625130.520784:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206123392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625130.520804:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625130.520835:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206123264 00000100:00100000:3.0:1788625130.520839:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206123264 00010000:00010000:3.0:1788625130.520874:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a1a0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a199 expref: 24 pid: 6505 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625130.520898:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206123392 00000100:00100000:3.0:1788625130.520901:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206123392 00010000:00010000:3.0:1788625130.520913:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7a07a lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a073 expref: 25 pid: 6506 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625130.520931:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788625130.520938:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6544f02a-cd81-4e03-84c5-408bee21ab7a+25:3637:x1875509206123264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625130.520959:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625130.520965:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a1a0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a199 expref: 25 pid: 6505 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.520975:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a1a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a199 expref: 25 pid: 6505 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.520993:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625130.521023:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6544f02a-cd81-4e03-84c5-408bee21ab7a+25:3637:x1875509206123264:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625130.521029:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788625130.521043:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788625130.521049:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3637:x1875509206123392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625130.521056:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625130.521060:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7a07a lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a073 expref: 24 pid: 6506 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.521068:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7a07a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a073 expref: 24 pid: 6506 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.521078:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625130.521098:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3637:x1875509206123392:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625130.521104:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788625130.521138:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206123392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625130.521147:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206123264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625130.521205:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998859be9600/0x2d2e3b3f34a7a026 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a01f expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.521222:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998859be9600/0x2d2e3b3f34a7a026 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a01f expref: 23 pid: 6503 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625130.521231:0:10388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875509206123520:0@lo:104: 00000100:00100000:3.0:1788625130.521255:0:10388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625130.521277:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206123520 00000100:00100000:3.0:1788625130.521280:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206123520 00000100:00100000:3.0:1788625130.521311:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788625130.521317:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:10388:x1875509206123520:12345-0@lo:104: 00010000:00010000:3.0:1788625130.521326:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998882171200/0x2d2e3b3f34a7a01f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a026 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.521360:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625130.521366:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:10388:x1875509206123520:12345-0@lo:104: Request processed in 49us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625130.521372:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1788625130.521387:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625130.521392:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998882171200/0x2d2e3b3f34a7a01f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a026 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.521399:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171200 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625130.521402:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998882171200/0x2d2e3b3f34a7a01f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a026 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.521410:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998882171200/0x2d2e3b3f34a7a01f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a026 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625130.521418:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998882171200/0x2d2e3b3f34a7a01f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a026 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625130.521430:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788625130.521446:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998882171200/0x2d2e3b3f34a7a01f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a026 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.521452:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625130.521470:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998882171200/0x2d2e3b3f34a7a01f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a026 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.521477:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998882171200/0x2d2e3b3f34a7a01f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a026 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.521490:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625130.521491:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625130.521493:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625130.521504:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206123648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625130.521562:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625130.521598:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206123648 00000100:00100000:3.0:1788625130.521602:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206123648 00010000:00010000:3.0:1788625130.521616:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998859be9600/0x2d2e3b3f34a7a026 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a01f expref: 24 pid: 6503 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625130.521636:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788625130.521642:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743686d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206123648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625130.521651:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625130.521655:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998859be9600/0x2d2e3b3f34a7a026 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a01f expref: 24 pid: 6503 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.521664:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998859be9600/0x2d2e3b3f34a7a026 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a01f expref: 24 pid: 6503 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625130.521682:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625130.522424:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625130.522783:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887cac7e00/0x2d2e3b3f34a7a018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a011 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625130.522796:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887cac7e00/0x2d2e3b3f34a7a018 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a011 expref: 24 pid: 6503 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625130.522807:0:10388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875509206123776:0@lo:104: 00000100:00100000:2.0:1788625130.522847:0:10388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625130.522884:0:10388:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788625130.522906:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a1a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a199 expref: 24 pid: 6505 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625130.522919:0:10388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875509206123008:0@lo:104: 00010000:00010000:2.0:1788625130.522941:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7a07a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a073 expref: 23 pid: 6506 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625130.522951:0:10388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875509206123136:0@lo:104: 00010000:00010000:2.0:1788625130.522982:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be9600/0x2d2e3b3f34a7a026 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a01f expref: 22 pid: 6503 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625130.522992:0:10388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875509206123520:0@lo:104: 00000100:00100000:1.0:1788625130.523731:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206123776 00000100:00100000:1.0:1788625130.523750:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206123776 00000100:00100000:1.0:1788625130.523806:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788625130.523815:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:10388:x1875509206123776:12345-0@lo:104: 00010000:00010000:1.0:1788625130.523828:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998859be9400/0x2d2e3b3f34a7a011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a018 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.523926:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788625130.523942:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:10388:x1875509206123776:12345-0@lo:104: Request processed in 129us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625130.523950:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788625130.523972:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625130.523979:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be9400/0x2d2e3b3f34a7a011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a018 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.523986:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9400 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625130.523990:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be9400/0x2d2e3b3f34a7a011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a018 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.523997:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be9400/0x2d2e3b3f34a7a011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a018 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625130.524005:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be9400/0x2d2e3b3f34a7a011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a018 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625130.524011:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788625130.524044:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998859be9400/0x2d2e3b3f34a7a011 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a018 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.524051:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625130.524073:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be9400/0x2d2e3b3f34a7a011 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a018 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.524086:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be9400/0x2d2e3b3f34a7a011 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a018 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.524119:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625130.524122:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625130.524123:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625130.524141:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206123904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625130.524182:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625130.524229:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206123904 00000100:00100000:1.0:1788625130.524234:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206123904 00010000:00010000:1.0:1788625130.524253:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887cac7e00/0x2d2e3b3f34a7a018 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a011 expref: 22 pid: 6503 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625130.524276:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788625130.524282:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:3636:x1875509206123904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625130.524294:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625130.524300:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887cac7e00/0x2d2e3b3f34a7a018 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a011 expref: 22 pid: 6503 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.524310:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887cac7e00/0x2d2e3b3f34a7a018 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a011 expref: 22 pid: 6503 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.524330:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625130.524357:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:3636:x1875509206123904:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625130.524364:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788625130.524414:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206123904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625130.524831:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac7e00/0x2d2e3b3f34a7a018 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a011 expref: 21 pid: 6503 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625130.524844:0:10388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875509206123776:0@lo:104: 00000100:00100000:3.0:1788625130.525963:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743686d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:3635:x1875509206123648:12345-0@lo:103:ldlm_bl.0 Request processed in 3744us (3824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625130.525978:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788625130.526075:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206123648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625130.526345:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625130.526371:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185092608 00000100:00100000:1.0:1788625130.526381:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185092608 00010000:00010000:1.0:1788625130.526417:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887b683a00/0x2d2e3b3f34a7a2b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df5d expref: 10 pid: 6506 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625130.526448:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 39 00000100:00100000:1.0:1788625130.526457:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2393:x1875509185092608:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625130.526471:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625130.526479:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887b683a00/0x2d2e3b3f34a7a2b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df5d expref: 10 pid: 6506 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.526492:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887b683a00/0x2d2e3b3f34a7a2b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df5d expref: 10 pid: 6506 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.526538:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a37c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.526549:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a37c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.526569:0:10331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a37c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.526577:0:10331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a37c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.526585:0:10331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a37c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.526610:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a37c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.526617:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625130.526622:0:10331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a37c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.526631:0:10331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a37c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.526641:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a37c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.526655:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625130.527071:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2393:x1875509185092608:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 614us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625130.527080:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 39 00010000:00010000:1.0:1788625130.527139:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b683a00/0x2d2e3b3f34a7a2b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df5d expref: 9 pid: 6506 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625130.527154:0:10388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875509206122880:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625130.527188:0:10388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a37c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.527199:0:10388:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a37c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.527205:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a37c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.527223:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a37c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625130.572193:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625130.769672:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206124032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625130.769777:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625130.770426:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206124160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625130.770472:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625130.772453:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206124032 00000100:00100000:0.0:1788625130.772471:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206124032 00000100:00100000:2.0:1788625130.772677:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206124160 00000100:00100000:2.0:1788625130.772683:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206124160 00000100:00100000:2.0:1788625130.772741:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788625130.772752:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206124160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788625130.772795:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625130.772904:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206124160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625130.772911:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788625130.773824:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439ff100 x1875509206124160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625130.773852:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206124160:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788625130.780681:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625130.790763:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788625130.790788:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206124032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625130.790830:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625130.790964:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206124032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (21187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625130.790972:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788625130.793633:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743686d80 x1875509206124032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625130.793666:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206124032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625131.275819:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206124672:0@lo:400:kworker.0 00000100:00100000:2.0:1788625131.275898:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625131.275947:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206125184:0@lo:400:kworker.0 00000100:00100000:2.0:1788625131.275969:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625131.275984:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206125696:0@lo:400:kworker.0 00000100:00100000:2.0:1788625131.276000:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625131.276051:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788625131.276056:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206124544:0@lo:400:kworker.0 00000100:00100000:2.0:1788625131.276088:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625131.276103:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206125056:0@lo:400:kworker.0 00000100:00100000:2.0:1788625131.276120:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625131.276132:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206125568:0@lo:400:kworker.0 00000100:00100000:2.0:1788625131.276156:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625131.276188:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206124672 00000100:00100000:2.0:1788625131.276196:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206124672 00000100:00100000:2.0:1788625131.276233:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206125056 00000100:00100000:2.0:1788625131.276235:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206125056 00000100:00100000:2.0:1788625131.276250:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206125568 00000100:00100000:2.0:1788625131.276252:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206125568 00000100:00100000:2.0:1788625131.276266:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788625131.276273:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206124672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625131.276320:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206124672:12345-0@lo:400:kworker.0 Request processed in 47us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625131.276327:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788625131.276341:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788625131.276346:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206125056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625131.276366:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206125056:12345-0@lo:400:kworker.0 Request processed in 20us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625131.276371:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788625131.276379:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788625131.276384:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206125568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625131.276401:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206125568:12345-0@lo:400:kworker.0 Request processed in 17us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625131.276415:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788625131.276430:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206125184 00000100:00100000:2.0:1788625131.276433:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206125184 00000100:00100000:2.0:1788625131.276450:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206125696 00000100:00100000:2.0:1788625131.276452:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206125696 00000100:00100000:2.0:1788625131.276466:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788625131.276471:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206125184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625131.276496:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206125184:12345-0@lo:400:kworker.0 Request processed in 25us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625131.276502:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788625131.276510:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788625131.276514:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206125696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625131.276584:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206125696:12345-0@lo:400:kworker.0 Request processed in 69us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625131.276590:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788625131.276609:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206124544 00000100:00100000:2.0:1788625131.276612:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206124544 00000100:00100000:2.0:1788625131.276632:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788625131.276637:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206124544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625131.276663:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206124544:12345-0@lo:400:kworker.0 Request processed in 26us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625131.276668:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788625131.276705:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206124544:0@lo:400:kworker.0 00010000:00080000:2.0:1788625131.276717:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bdc00 x1875509206125056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625131.276726:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206125056:0@lo:400:kworker.0 00010000:00080000:2.0:1788625131.276741:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bea00 x1875509206125568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625131.276749:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206125568:0@lo:400:kworker.0 00000100:00100000:2.0:1788625131.276758:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206124672:0@lo:400:kworker.0 00010000:00080000:2.0:1788625131.276765:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bc380 x1875509206125184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625131.276773:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206125184:0@lo:400:kworker.0 00010000:00080000:2.0:1788625131.276781:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844937480 x1875509206125696/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625131.276788:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206125696:0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.276944:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206124288:0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.276978:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625131.277014:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206124800:0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.277033:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625131.277048:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206125312:0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.277064:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625131.277076:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206125824:0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.277090:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625131.277103:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788625131.277108:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206124416:0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.277125:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625131.277136:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206124928:0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.277159:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625131.277184:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206125440:0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.277200:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625131.277217:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206124416 00000100:00100000:3.0:1788625131.277220:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206124416 00000100:00100000:3.0:1788625131.277236:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206124928 00000100:00100000:3.0:1788625131.277238:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206124928 00000100:00100000:3.0:1788625131.277248:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206125440 00000100:00100000:3.0:1788625131.277250:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206125440 00000100:00100000:3.0:1788625131.277260:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788625131.277265:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206124416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.277295:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206124416:12345-0@lo:400:kworker.0 Request processed in 29us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625131.277301:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788625131.277312:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788625131.277317:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206124928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.277336:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206124928:12345-0@lo:400:kworker.0 Request processed in 20us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625131.277341:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788625131.277349:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788625131.277353:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206125440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.277371:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206125440:12345-0@lo:400:kworker.0 Request processed in 18us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625131.277376:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788625131.277391:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625131.277395:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625131.277397:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625131.277411:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206125312 00000100:00100000:3.0:1788625131.277414:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206125312 00000100:00100000:3.0:1788625131.277427:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206125824 00000100:00100000:3.0:1788625131.277429:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206125824 00000100:00100000:3.0:1788625131.277443:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788625131.277447:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206125312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.277472:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206125312:12345-0@lo:400:kworker.0 Request processed in 24us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625131.277478:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788625131.277486:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788625131.277490:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206125824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.277508:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206125824:12345-0@lo:400:kworker.0 Request processed in 18us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625131.277513:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788625131.277556:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625131.277563:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206124800 00000100:00100000:3.0:1788625131.277566:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206124800 00000100:00100000:3.0:1788625131.277584:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788625131.277589:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206124800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.277613:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206124800:12345-0@lo:400:kworker.0 Request processed in 24us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625131.277619:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788625131.277645:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206124416:0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.277653:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206124928:0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.277660:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206125440:0@lo:400:kworker.0 00000100:00100000:3.0:1788625131.277667:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206124800:0@lo:400:kworker.0 00010000:00080000:3.0:1788625131.277682:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8be680 x1875509206125312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625131.277690:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206125312:0@lo:400:kworker.0 00010000:00080000:3.0:1788625131.277698:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844934e00 x1875509206125824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625131.277705:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206125824:0@lo:400:kworker.0 00000100:00100000:2.0:1788625131.277874:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206124288 00000100:00100000:2.0:1788625131.277879:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206124288 00000100:00100000:2.0:1788625131.277909:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788625131.277915:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:3635:x1875509206124288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625131.277945:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:3635:x1875509206124288:12345-0@lo:400:kworker.0 Request processed in 30us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625131.277950:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788625131.278697:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206124288:0@lo:400:kworker.0 00010000:00010000:0.0:1788625131.604537:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788625131.660357:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788625131.660365:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9988449c9000 from 4 10000000:01000000:1.0:1788625131.660370:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625131.660418:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8400/0x2d2e3b3f34a7a383 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625131.660431:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998859be8400/0x2d2e3b3f34a7a383 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625131.660442:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998859be8400/0x2d2e3b3f34a7a383 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625131.660467:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206125952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788625131.660577:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625131.660624:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743a90180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625131.660754:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206125952 00000100:00100000:2.0:1788625131.660762:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206125952 00000100:00100000:2.0:1788625131.660809:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788625131.660819:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206125952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625131.660832:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625131.660857:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887cac6e00/0x2d2e3b3f34a7a38a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a383 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625131.660910:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac6e00/0x2d2e3b3f34a7a38a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a383 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625131.660922:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887cac6e00/0x2d2e3b3f34a7a38a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a383 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625131.660931:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6e00, rc 0) 00000100:00100000:2.0:1788625131.660987:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206125952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625131.660994:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788625131.661174:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206125952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625131.661188:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998859be8400/0x2d2e3b3f34a7a383 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a38a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625131.661196:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998859be8400/0x2d2e3b3f34a7a383 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a38a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625131.661255:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206126080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625131.661280:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625131.661317:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743a90180 going to sleep for 11 seconds 00000100:00100000:3.0:1788625131.661500:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206126080 00000100:00100000:3.0:1788625131.661505:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206126080 00000100:00100000:3.0:1788625131.661554:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788625131.661560:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206126080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625131.661670:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206126080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625131.661677:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788625131.661708:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206126080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625131.661736:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206126208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625131.661774:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625131.661793:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788625131.661803:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206126208 00000100:00100000:3.0:1788625131.661806:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206126208 00000100:00100000:3.0:1788625131.661824:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788625131.661830:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206126208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625131.661924:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206126208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625131.661938:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788625131.662152:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206126208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625131.662326:0:10420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10420:1875509206126336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625131.662361:0:10420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625131.662379:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206126336 00000100:00100000:3.0:1788625131.662383:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206126336 00000100:00100000:3.0:1788625131.662400:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788625131.662406:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:10420:x1875509206126336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625131.662470:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:10420:x1875509206126336:12345-0@lo:502:llog_process_th.0 Request processed in 63us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625131.662477:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788625131.662504:0:10420:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788625131.662556:0:10420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10420:1875509206126336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788625131.662577:0:10420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625131.662586:0:10420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625131.662588:0:10420:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788625131.662594:0:10420:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9988449c9000 00000020:00000080:3.0:1788625131.662597:0:10420:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788625131.669831:0:10420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10420:1875509206126464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625131.669933:0:10420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625131.669981:0:10420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da180 going to sleep for 11 seconds 00000100:00100000:3.0:1788625131.670201:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206126464 00000100:00100000:3.0:1788625131.670209:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206126464 00000100:00100000:3.0:1788625131.670263:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788625131.670273:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:10420:x1875509206126464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625131.670398:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:10420:x1875509206126464:12345-0@lo:502:llog_process_th.0 Request processed in 125us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625131.670405:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788625131.670780:0:10420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10420:1875509206126464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788625131.670807:0:10420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625131.670814:0:10420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625131.670816:0:10420:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788625131.670819:0:10420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788625131.671024:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788625131.671047:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788625131.671057:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8400/0x2d2e3b3f34a7a383 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a38a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625131.671068:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be8400/0x2d2e3b3f34a7a383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a38a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625131.671079:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788625131.671082:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998878127800 from 4 10000000:01000000:3.0:1788625131.671085:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625131.671112:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7a391 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625131.671614:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7a391 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625131.671627:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7a391 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625131.671645:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206126592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625131.671690:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625131.671722:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625131.671739:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206126592 00000100:00100000:3.0:1788625131.671744:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206126592 00000100:00100000:3.0:1788625131.671770:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788625131.671777:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206126592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625131.671787:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625131.673061:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a398 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a391 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625131.673232:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a391 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625131.673247:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a391 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625131.673257:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682000, rc 0) 00000100:00100000:2.0:1788625131.673321:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206126592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1543us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625131.673338:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788625131.673400:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206126592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625131.673415:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7a391 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a398 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625131.673424:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7a391 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a398 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625131.675042:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206126720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625131.675097:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625131.675144:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206126720 00000100:00100000:0.0:1788625131.675151:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206126720 00000100:00100000:0.0:1788625131.675195:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788625131.675205:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206126720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625131.675312:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206126720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625131.675318:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788625131.675633:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625131.675654:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206126720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625131.675693:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206126848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625131.675736:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625131.675764:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625131.678069:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206126848 00000100:00100000:0.0:1788625131.678081:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206126848 00000100:00100000:0.0:1788625131.678150:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788625131.678161:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206126848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625131.678320:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206126848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625131.678328:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788625131.678398:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206126848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625131.678653:0:10423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10423:1875509206126976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625131.678696:0:10423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625131.678720:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206126976 00000100:00100000:0.0:1788625131.678724:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206126976 00000100:00100000:0.0:1788625131.678747:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788625131.678753:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:10423:x1875509206126976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625131.678820:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:10423:x1875509206126976:12345-0@lo:502:llog_process_th.0 Request processed in 67us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625131.678827:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788625131.678880:0:10423:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b477540 going to sleep for 11 seconds 00000100:00100000:0.0:1788625131.678893:0:10423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10423:1875509206126976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788625131.678913:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625131.678923:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625131.678925:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788625131.678932:0:10423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998878127800 00000020:00000080:0.0:1788625131.678934:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788625131.683320:0:10423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10423:1875509206127104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625131.683403:0:10423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625131.683441:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206127104 00000100:00100000:0.0:1788625131.683448:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206127104 00000100:00100000:0.0:1788625131.683492:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788625131.683501:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:10423:x1875509206127104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625131.683992:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:10423:x1875509206127104:12345-0@lo:502:llog_process_th.0 Request processed in 491us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625131.684001:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788625131.684055:0:10423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625131.684075:0:10423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10423:1875509206127104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788625131.684101:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625131.684109:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625131.684111:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788625131.684115:0:10423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788625131.687688:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788625131.687714:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788625131.687726:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7a391 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a398 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625131.687740:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7a391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a398 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625131.687751:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788625131.687753:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99886c323000 from 4 10000000:01000000:0.0:1788625131.687756:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788625131.687798:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c995c00/0x2d2e3b3f34a7a39f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625131.687806:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887c995c00/0x2d2e3b3f34a7a39f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625131.687816:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887c995c00/0x2d2e3b3f34a7a39f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625131.688123:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206127232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625131.688264:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625131.688310:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625131.690032:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206127232 00000100:00100000:1.0:1788625131.690044:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206127232 00000100:00100000:1.0:1788625131.690101:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788625131.690111:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206127232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625131.690128:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625131.692066:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a3a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a39f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625131.692105:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a3a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a39f expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625131.692622:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a3a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a39f expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625131.692635:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be9200, rc 0) 00000100:00100000:1.0:1788625131.692867:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206127232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2756us (4601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625131.692876:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788625131.693219:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206127232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625131.693242:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887c995c00/0x2d2e3b3f34a7a39f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a3a6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625131.693254:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887c995c00/0x2d2e3b3f34a7a39f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a3a6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625131.693344:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206127360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625131.693386:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625131.693417:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625131.693435:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206127360 00000100:00100000:0.0:1788625131.693439:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206127360 00000100:00100000:0.0:1788625131.693477:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788625131.693487:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206127360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625131.697005:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206127360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3509us (3607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625131.697020:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788625131.701456:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206127360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625131.702152:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206127488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625131.702309:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625131.702461:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206127488 00000100:00100000:1.0:1788625131.702469:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206127488 00000100:00100000:1.0:1788625131.702536:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788625131.702548:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206127488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625131.703073:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206127488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 525us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625131.703090:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788625131.703148:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743a90600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625131.703299:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206127488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625131.705262:0:10426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10426:1875509206127616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625131.705343:0:10426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625131.705428:0:10426:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743a90f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625131.705501:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206127616 00000100:00100000:2.0:1788625131.705509:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206127616 00000100:00100000:2.0:1788625131.705599:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788625131.705609:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:10426:x1875509206127616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625131.706575:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:10426:x1875509206127616:12345-0@lo:502:llog_process_th.0 Request processed in 953us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625131.706593:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788625131.706731:0:10426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10426:1875509206127616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625131.706775:0:10426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625131.706786:0:10426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625131.706789:0:10426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788625131.706796:0:10426:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99886c323000 00000020:00000080:1.0:1788625131.706799:0:10426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788625131.706879:0:10426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10426:1875509206127744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625131.706928:0:10426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625131.706954:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206127744 00000100:00100000:1.0:1788625131.706958:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206127744 00000100:00100000:1.0:1788625131.707000:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788625131.707008:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:10426:x1875509206127744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625131.707090:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:10426:x1875509206127744:12345-0@lo:502:llog_process_th.0 Request processed in 82us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625131.707098:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788625131.707136:0:10426:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743a90f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625131.707148:0:10426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10426:1875509206127744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625131.707165:0:10426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625131.707169:0:10426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625131.707175:0:10426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788625131.707179:0:10426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788625131.707249:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788625131.707272:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625131.707283:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c995c00/0x2d2e3b3f34a7a39f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a3a6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625131.707300:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887c995c00/0x2d2e3b3f34a7a39f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a3a6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625131.707310:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788625131.707313:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998852348000 from 4 10000000:01000000:2.0:1788625131.707315:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788625131.707342:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a3ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625131.707349:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a3ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625131.707358:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a3ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625131.707370:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206127872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788625131.707399:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625131.707423:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da540 going to sleep for 11 seconds 00000100:00100000:1.0:1788625131.707463:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206127872 00000100:00100000:1.0:1788625131.707468:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206127872 00000100:00100000:1.0:1788625131.707490:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788625131.707496:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206127872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625131.707505:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625131.707536:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998859be9400/0x2d2e3b3f34a7a3b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a3ad expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625131.708342:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998859be9400/0x2d2e3b3f34a7a3b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a3ad expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625131.708355:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998859be9400/0x2d2e3b3f34a7a3b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a3ad expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625131.708364:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be9400, rc 0) 00000100:00100000:1.0:1788625131.708419:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206127872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 922us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625131.708427:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788625131.708431:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206127872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625131.708448:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a3ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a3b4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625131.708458:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a3ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a3b4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625131.708539:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206128000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625131.708567:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625131.708612:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da540 going to sleep for 11 seconds 00000100:00100000:2.0:1788625131.708627:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206128000 00000100:00100000:2.0:1788625131.708631:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206128000 00000100:00100000:2.0:1788625131.708657:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788625131.708664:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206128000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625131.708762:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206128000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625131.708769:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788625131.709213:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206128000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625131.709240:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206128128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625131.709281:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625131.709307:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da540 going to sleep for 11 seconds 00000100:00100000:3.0:1788625131.709670:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206128128 00000100:00100000:3.0:1788625131.709676:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206128128 00000100:00100000:3.0:1788625131.709709:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788625131.709718:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206128128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625131.710194:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206128128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 477us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625131.710203:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788625131.710322:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206128128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625131.712572:0:10429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10429:1875509206128256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625131.713504:0:10429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625131.713912:0:10429:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788625131.713925:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206128256 00000100:00100000:2.0:1788625131.713936:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206128256 00000100:00100000:2.0:1788625131.713983:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788625131.713995:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:10429:x1875509206128256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625131.714198:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:10429:x1875509206128256:12345-0@lo:502:llog_process_th.0 Request processed in 205us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625131.714206:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788625131.714371:0:10429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10429:1875509206128256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788625131.714409:0:10429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625131.714419:0:10429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625131.714422:0:10429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788625131.714430:0:10429:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998852348000 00000020:00000080:3.0:1788625131.714651:0:10429:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788625131.717178:0:10429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10429:1875509206128384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625131.717359:0:10429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625131.717406:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206128384 00000100:00100000:3.0:1788625131.717414:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206128384 00000100:00100000:3.0:1788625131.717620:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788625131.717629:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:10429:x1875509206128384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625131.718273:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:10429:x1875509206128384:12345-0@lo:502:llog_process_th.0 Request processed in 643us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625131.718284:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788625131.718357:0:10429:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788625131.718381:0:10429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:10429:1875509206128384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788625131.718417:0:10429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625131.718425:0:10429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625131.718428:0:10429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788625131.718885:0:10429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788625131.719309:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788625131.719332:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625131.719344:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a3ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a3b4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625131.719357:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a3ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a3b4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625131.791793:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206128512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625131.791858:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625131.791875:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206128640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625131.791915:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625131.791931:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625131.791995:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206128640 00000100:00100000:3.0:1788625131.792002:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206128640 00000100:00100000:1.0:1788625131.792018:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206128512 00000100:00100000:1.0:1788625131.792023:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206128512 00000100:00100000:3.0:1788625131.792061:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788625131.792062:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788625131.792081:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206128640:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625131.792081:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206128512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625131.792120:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00002000:00000024:3.0:1788625131.792121:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625131.792183:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206128512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625131.792201:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788625131.792226:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206128768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625131.792250:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625131.792287:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206128768 00000100:00100000:1.0:1788625131.792290:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206128768 00000100:00100000:1.0:1788625131.792307:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788625131.792313:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206128768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788625131.792323:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625131.792351:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206128768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625131.792357:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788625131.792399:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887cb10e00 x1875509206128768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625131.792416:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206128768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625131.794827:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206128512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625131.795405:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206128640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3330us (3471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625131.795417:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788625131.796904:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742e43800 x1875509206128640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625131.796931:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206128640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625131.965735:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625131.966123:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185092736 00000100:00100000:2.0:1788625131.966134:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185092736 00000100:00100000:2.0:1788625131.966196:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 273 00000100:00100000:2.0:1788625131.966207:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:6164:x1875509185092736:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625131.966226:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625131.966244:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a3bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3dfa3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625131.966274:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a3bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfa3 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625131.966287:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a3bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfa3 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625131.966308:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7800, rc 0) 00000100:00100000:2.0:1788625131.966368:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6164:x1875509185092736:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 Request processed in 162us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625131.966376:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 273 00000100:00100000:2.0:1788625131.976093:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625131.976163:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185092864 00000100:00100000:3.0:1788625131.976174:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185092864 00000100:00100000:3.0:1788625131.976236:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 274 00000100:00100000:3.0:1788625131.976246:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6164:x1875509185092864:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625131.976386:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6164:x1875509185092864:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 Request processed in 141us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625131.976394:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 274 00000100:00100000:3.0:1788625131.979018:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625131.979057:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185092992 00000100:00100000:3.0:1788625131.979073:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185092992 00000100:00100000:3.0:1788625131.979117:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 275 00000100:00100000:3.0:1788625131.979126:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6164:x1875509185092992:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625131.979255:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6164:x1875509185092992:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 Request processed in 129us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625131.979263:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 275 00000100:00100000:3.0:1788625131.988000:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625131.988744:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185093120 00000100:00100000:1.0:1788625131.988756:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185093120 00000100:00100000:1.0:1788625131.988820:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 276 00000100:00100000:1.0:1788625131.988843:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6719:x1875509185093120:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788625131.989010:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6719:x1875509185093120:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 179us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625131.989018:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 276 00000100:00100000:3.0:1788625131.993214:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625131.993364:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185093248 00000100:00100000:0.0:1788625131.993374:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185093248 00000100:00100000:0.0:1788625131.993429:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 277 00000100:00100000:0.0:1788625131.993439:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6719:x1875509185093248:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625131.993613:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:6719:x1875509185093248:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 174us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625131.993623:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 277 00010000:00010000:1.0:1788625132.630299:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625133.644432:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625134.588411:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625134.588586:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625134.588613:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625134.588631:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625134.588650:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625134.588682:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185093888 00000100:00100000:3.0:1788625134.588694:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185093888 00000100:00100000:3.0:1788625134.588762:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185093760 00000100:00100000:3.0:1788625134.588765:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185093760 00000100:00100000:3.0:1788625134.588803:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 31 00000100:00100000:3.0:1788625134.588817:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185093888:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625134.589031:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185093888:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 217us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625134.589040:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 31 00000100:00100000:3.0:1788625134.589063:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 32 00000100:00100000:3.0:1788625134.589076:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185093760:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625134.589102:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185093760:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 33us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625134.589128:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 32 00000100:00100000:3.0:1788625134.589152:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185093632 00000100:00100000:3.0:1788625134.589157:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185093632 00000100:00100000:3.0:1788625134.589187:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185093504 00000100:00100000:3.0:1788625134.589191:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185093504 00000100:00100000:3.0:1788625134.589212:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 80 00000100:00100000:3.0:1788625134.589218:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185093632:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625134.589251:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185093632:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 32us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625134.589257:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 80 00000100:00100000:3.0:1788625134.589271:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 81 00000100:00100000:3.0:1788625134.589277:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2391:x1875509185093504:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625134.589303:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2391:x1875509185093504:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 26us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625134.589309:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 81 00000100:00080000:3.0:1788625134.589331:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625134.589335:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625134.589338:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625134.589340:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625134.590212:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185093376 00000100:00100000:1.0:1788625134.590222:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185093376 00000100:00100000:1.0:1788625134.590331:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 278 00000100:00100000:1.0:1788625134.590341:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2391:x1875509185093376:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625134.590404:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2391:x1875509185093376:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 64us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625134.590416:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 278 00010000:00010000:1.0:1788625134.670171:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625135.372729:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206128896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625135.372811:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625135.372965:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206128896 00000100:00100000:3.0:1788625135.372973:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206128896 00000100:00100000:3.0:1788625135.373026:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788625135.373036:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206128896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788625135.373072:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788625135.373122:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206128896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625135.373139:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788625135.373224:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206128896:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788625135.692945:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625135.884038:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625135.884061:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206129152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625135.884136:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625135.884299:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206129024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788625135.884329:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625135.885459:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206129152 00000100:00100000:3.0:1788625135.885470:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206129152 00000100:00100000:3.0:1788625135.885541:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206129024 00000100:00100000:3.0:1788625135.885545:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206129024 00000100:00100000:3.0:1788625135.885565:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788625135.885573:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206129152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788625135.885602:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625135.885668:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206129152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625135.885675:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788625135.885694:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788625135.885700:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206129024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788625135.885711:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625135.885741:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206129024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625135.885747:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788625135.885799:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439ff100 x1875509206129152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625135.885827:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206129152:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788625135.885934:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788625135.885997:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439fea00 x1875509206129024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625135.886012:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206129024:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1788625136.200316:0:10688:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1788625136.397721:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206129280:0@lo:400:kworker.0 00000100:00100000:3.0:1788625136.397809:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625136.397810:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206129664:0@lo:400:kworker.0 00000100:00100000:3.0:1788625136.397862:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206129792:0@lo:400:kworker.0 00000100:00100000:2.0:1788625136.397879:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206129280 00000100:00100000:2.0:1788625136.397886:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206129280 00000100:00100000:2.0:1788625136.397939:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788625136.397948:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206129280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.402018:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625136.402068:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206130176:0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.402112:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625136.402133:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206130688:0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.402159:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625136.402186:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788625136.402193:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206130304:0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.402231:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625136.402250:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206130816:0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.402268:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625136.402302:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206129408:0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.402324:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625136.402342:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206129920:0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.402363:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625136.402380:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206130432:0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.402399:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625136.402419:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788625136.402425:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206129536:0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.402449:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625136.402466:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206130048:0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.402486:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625136.402497:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206130560:0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.402514:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625136.402565:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206129664 00000100:00100000:1.0:1788625136.402578:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206129664 00000100:00100000:1.0:1788625136.402617:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206129408 00000100:00100000:1.0:1788625136.402620:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206129408 00000100:00100000:1.0:1788625136.402632:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206129920 00000100:00100000:1.0:1788625136.402634:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206129920 00000100:00100000:1.0:1788625136.402656:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206130432 00000100:00100000:1.0:1788625136.402659:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206130432 00000100:00100000:1.0:1788625136.402672:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206130048 00000100:00100000:1.0:1788625136.402674:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206130048 00000100:00100000:1.0:1788625136.402686:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206130560 00000100:00100000:1.0:1788625136.402695:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206130560 00000100:00100000:1.0:1788625136.402713:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788625136.402721:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206129664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.402787:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206129664:12345-0@lo:400:kworker.0 Request processed in 66us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625136.402795:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788625136.402811:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788625136.402817:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206129408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.402848:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206129408:12345-0@lo:400:kworker.0 Request processed in 32us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625136.402854:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788625136.402865:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788625136.402870:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206129920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.402895:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206129920:12345-0@lo:400:kworker.0 Request processed in 26us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625136.402901:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788625136.402912:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788625136.402918:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206130432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.402944:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206130432:12345-0@lo:400:kworker.0 Request processed in 28us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625136.402950:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788625136.402961:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788625136.402966:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206130048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.403010:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206130048:12345-0@lo:400:kworker.0 Request processed in 43us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625136.403024:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788625136.403036:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788625136.403042:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206130560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.403070:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206130560:12345-0@lo:400:kworker.0 Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625136.403075:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788625136.403094:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206130176 00000100:00100000:1.0:1788625136.403097:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206130176 00000100:00100000:1.0:1788625136.403111:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206130688 00000100:00100000:1.0:1788625136.403113:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206130688 00000100:00100000:1.0:1788625136.403122:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206130304 00000100:00100000:1.0:1788625136.403123:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206130304 00000100:00100000:1.0:1788625136.403130:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206130816 00000100:00100000:1.0:1788625136.403132:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206130816 00000100:00100000:1.0:1788625136.403142:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788625136.403147:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206130176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.403174:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206130176:12345-0@lo:400:kworker.0 Request processed in 27us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625136.403181:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788625136.403191:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788625136.403197:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998874f17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206130688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.403222:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998874f17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206130688:12345-0@lo:400:kworker.0 Request processed in 26us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625136.403228:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788625136.403368:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788625136.403374:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206130304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.403411:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206130304:12345-0@lo:400:kworker.0 Request processed in 37us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625136.403418:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788625136.403430:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788625136.403437:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206130816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.403462:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206130816:12345-0@lo:400:kworker.0 Request processed in 26us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625136.403468:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788625136.403507:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206129536 00000100:00100000:1.0:1788625136.403511:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206129536 00000100:00100000:1.0:1788625136.403559:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788625136.403565:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206129536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.403596:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206129536:12345-0@lo:400:kworker.0 Request processed in 31us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625136.403601:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788625136.404085:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625136.404091:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625136.404093:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625136.404128:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206129536:0@lo:400:kworker.0 00010000:00080000:1.0:1788625136.404142:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887cb10380 x1875509206130048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625136.404153:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206130048:0@lo:400:kworker.0 00010000:00080000:1.0:1788625136.404163:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987438cf100 x1875509206130560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625136.404172:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206130560:0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.404194:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206129408:0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.404204:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206129920:0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.404213:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206130432:0@lo:400:kworker.0 00010000:00080000:1.0:1788625136.404458:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887cb13100 x1875509206130304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625136.404468:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206130304:0@lo:400:kworker.0 00010000:00080000:1.0:1788625136.404479:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987438cc380 x1875509206130816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625136.404487:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206130816:0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.404498:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206129664:0@lo:400:kworker.0 00010000:00080000:1.0:1788625136.404509:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887cb13480 x1875509206130176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625136.404539:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206130176:0@lo:400:kworker.0 00010000:00080000:1.0:1788625136.404551:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987438cf480 x1875509206130688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625136.404560:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206130688:0@lo:400:kworker.0 00000100:00100000:3.0:1788625136.407913:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625136.407993:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206129792 00000100:00100000:3.0:1788625136.408008:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206129792 00000100:00100000:3.0:1788625136.408466:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788625136.408565:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206129792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625136.408583:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206129280:12345-0@lo:400:kworker.0 Request processed in 10633us (10771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625136.408594:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788625136.408626:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206129792:12345-0@lo:400:kworker.0 Request processed in 68us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625136.408692:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206129280:0@lo:400:kworker.0 00000100:00100000:1.0:1788625136.408707:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206129792:0@lo:400:kworker.0 00000100:00100000:3.0:1788625136.412725:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:1.0:1788625136.715770:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625136.907810:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206130944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625136.907888:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625136.908007:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625136.908016:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206131072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625136.908051:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206130944 00000100:00100000:3.0:1788625136.908058:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625136.908073:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206130944 00000100:00100000:1.0:1788625136.908125:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788625136.908136:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206130944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625136.908179:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788625136.908235:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206130944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625136.908242:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788625136.908300:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206131072 00000100:00100000:2.0:1788625136.908305:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206131072 00000100:00100000:2.0:1788625136.908344:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788625136.908351:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206131072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625136.908370:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625136.908413:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206131072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625136.908420:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788625136.908867:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998741dc0000 x1875509206131072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625136.908888:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206131072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625136.908901:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206130944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625136.909117:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625136.909129:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206131200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625136.909176:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625136.909256:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206131200 00000100:00100000:0.0:1788625136.909261:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206131200 00000100:00100000:0.0:1788625136.909297:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788625136.909304:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206131200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625136.909317:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625136.909360:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206131200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625136.909366:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788625136.909580:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743aed180 x1875509206131200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625136.909604:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206131200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788625137.742724:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625138.763823:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625139.716411:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625139.716509:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625139.716567:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625139.716707:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185094272 00000100:00100000:0.0:1788625139.716719:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185094272 00000100:00100000:3.0:1788625139.716737:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185094144 00000100:00100000:3.0:1788625139.716743:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185094144 00000100:00100000:0.0:1788625139.716791:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 88 00000100:00100000:0.0:1788625139.716803:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185094272:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625139.716811:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 89 00000100:00100000:3.0:1788625139.716822:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185094144:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625139.716891:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185094272:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 90us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625139.716900:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 88 00000100:00080000:0.0:1788625139.716922:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788625139.716932:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625139.717052:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185094144:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 232us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625139.717061:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 89 00000100:00100000:2.0:1788625139.717179:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185094016 00000100:00100000:2.0:1788625139.717185:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185094016 00000100:00100000:2.0:1788625139.717225:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 280 00000100:00100000:2.0:1788625139.717233:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2394:x1875509185094016:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625139.717280:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2394:x1875509185094016:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 47us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625139.717287:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 280 00000100:00100000:3.0:1788625139.726590:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625139.726658:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185094400 00000100:00100000:1.0:1788625139.726670:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185094400 00000100:00080000:0.0:1788625139.726742:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625139.726809:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:1.0:1788625139.726823:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2390:x1875509185094400:12345-192.168.204.14@tcp:9:kworker.0 00000020:00000080:1.0:1788625139.726864:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a2cd 00000100:00080000:1.0:1788625139.726876:0:8423:0:(import.c:65:import_set_state_nolock()) ffff99887f8c6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788625139.726937:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788625139.727113:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+2:2390:x1875509185094400:12345-192.168.204.14@tcp:9:kworker.0 Request processed in 292us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625139.727121:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 18 00010000:00010000:0.0:1788625139.727155:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625139.741129:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625139.741612:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185094528 00000100:00100000:3.0:1788625139.741622:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185094528 00000100:00100000:3.0:1788625139.743878:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:3.0:1788625139.743892:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2390:x1875509185094528:12345-192.168.204.14@tcp:9:kworker.0 00000020:00000080:3.0:1788625139.743931:0:8425:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a2d4 00000100:00080000:3.0:1788625139.743943:0:8425:0:(import.c:65:import_set_state_nolock()) ffff99885ee8a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788625139.743987:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788625139.744153:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+2:2390:x1875509185094528:12345-192.168.204.14@tcp:9:kworker.0 Request processed in 264us (3641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625139.744161:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 19 00010000:00010000:3.0:1788625139.744220:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788625139.746980:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788625139.788600:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625140.492684:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625140.492711:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206131328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625140.492840:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625140.493204:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206131328 00000100:00100000:3.0:1788625140.493214:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206131328 00000100:00100000:3.0:1788625140.493276:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788625140.493287:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206131328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788625140.493332:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788625140.493403:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206131328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625140.493410:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788625140.493459:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206131328:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788625140.812389:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625141.003672:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625141.003695:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206131456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625141.003767:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625141.003993:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206131456 00000100:00100000:1.0:1788625141.004003:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206131456 00000100:00100000:1.0:1788625141.004078:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788625141.004090:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206131456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788625141.004155:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625141.004208:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206131456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625141.004215:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788625141.004256:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439fc380 x1875509206131456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625141.004274:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206131456:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788625141.004497:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625141.004682:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206131584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625141.004715:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625141.012997:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206131584 00000100:00100000:1.0:1788625141.013014:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206131584 00000100:00080000:0.0:1788625141.013046:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625141.013089:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788625141.013099:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206131584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625141.013125:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625141.013337:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206131584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 239us (8620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625141.013345:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788625141.013756:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987438cdc00 x1875509206131584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625141.013779:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206131584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625141.523772:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206131840:0@lo:400:kworker.0 00000100:00100000:2.0:1788625141.525178:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625141.525254:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625141.525266:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206131712:0@lo:400:kworker.0 00000100:00100000:2.0:1788625141.525303:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625141.525352:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206131712 00000100:00100000:2.0:1788625141.525361:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206131712 00000100:00100000:3.0:1788625141.525590:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206131968:0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.525647:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625141.525674:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206132480:0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.525711:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625141.525745:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206132992:0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.525772:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625141.526021:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206131840 00000100:00100000:0.0:1788625141.526026:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206131840 00000100:00100000:0.0:1788625141.526068:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206132480 00000100:00100000:0.0:1788625141.526071:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206132480 00000100:00100000:0.0:1788625141.526102:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788625141.526111:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206131840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625141.526164:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206131840:12345-0@lo:400:kworker.0 Request processed in 54us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625141.526171:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788625141.526188:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788625141.526195:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206132480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625141.526219:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206132480:12345-0@lo:400:kworker.0 Request processed in 26us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625141.526232:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788625141.526251:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206132096:0@lo:400:kworker.0 00000100:00100000:0.0:1788625141.526277:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625141.526294:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206132608:0@lo:400:kworker.0 00000100:00100000:0.0:1788625141.526312:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788625141.526626:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743aeca80 x1875509206132480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625141.526651:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206132480:0@lo:400:kworker.0 00000100:00100000:0.0:1788625141.526925:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206132096 00000100:00100000:0.0:1788625141.526930:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206132096 00000100:00100000:0.0:1788625141.526960:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206132608 00000100:00100000:0.0:1788625141.526962:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206132608 00000100:00100000:0.0:1788625141.526976:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788625141.526982:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206132096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625141.527024:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206132096:12345-0@lo:400:kworker.0 Request processed in 41us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625141.527029:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788625141.527042:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788625141.527047:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206132608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625141.527069:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206132608:12345-0@lo:400:kworker.0 Request processed in 22us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625141.527074:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1788625141.527092:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788625141.527095:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625141.527118:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206132096:0@lo:400:kworker.0 00000100:00100000:0.0:1788625141.527126:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206132608:0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.527189:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206132352:0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.527217:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625141.527244:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206132864:0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.527266:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625141.527292:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206131840:0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.527304:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788625141.527311:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206132224:0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.527335:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625141.527355:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206132736:0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.527389:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625141.527424:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206131968 00000100:00100000:3.0:1788625141.527428:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206131968 00000100:00100000:3.0:1788625141.527449:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206132224 00000100:00100000:3.0:1788625141.527451:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206132224 00000100:00100000:3.0:1788625141.527462:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788625141.527467:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206131968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.527514:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206131968:12345-0@lo:400:kworker.0 Request processed in 46us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625141.527537:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788625141.527549:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788625141.527555:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206132224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.527581:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206132224:12345-0@lo:400:kworker.0 Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625141.527586:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788625141.527601:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206132992 00000100:00100000:3.0:1788625141.527604:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206132992 00000100:00100000:3.0:1788625141.527627:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206132864 00000100:00100000:3.0:1788625141.527629:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206132864 00000100:00100000:3.0:1788625141.527659:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788625141.527665:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206132992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.527693:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206132992:12345-0@lo:400:kworker.0 Request processed in 29us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625141.527699:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788625141.527709:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788625141.527715:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206132864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.527753:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206132864:12345-0@lo:400:kworker.0 Request processed in 39us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625141.527759:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788625141.527795:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206131968:0@lo:400:kworker.0 00010000:00080000:3.0:1788625141.527808:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743aece00 x1875509206132992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625141.527818:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206132992:0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.527850:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206132224:0@lo:400:kworker.0 00010000:00080000:3.0:1788625141.527860:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743aec700 x1875509206132864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625141.527868:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206132864:0@lo:400:kworker.0 00000100:00100000:0.0:1788625141.528147:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206132352 00000100:00100000:0.0:1788625141.528151:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206132352 00000100:00100000:0.0:1788625141.528187:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206132736 00000100:00100000:0.0:1788625141.528191:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206132736 00000100:00100000:0.0:1788625141.528210:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788625141.528216:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206132352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625141.528251:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206132352:12345-0@lo:400:kworker.0 Request processed in 35us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625141.528256:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788625141.528267:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788625141.528272:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206132736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625141.528294:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206132736:12345-0@lo:400:kworker.0 Request processed in 23us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625141.528299:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1788625141.528316:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788625141.528319:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788625141.528322:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788625141.528391:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743aed880 x1875509206132736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625141.528411:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206132736:0@lo:400:kworker.0 00000100:00100000:0.0:1788625141.528423:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206132352:0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.532136:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788625141.532165:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206131712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625141.532284:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206131712:12345-0@lo:400:kworker.0 Request processed in 134us (6979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625141.532292:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788625141.533324:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206131712:0@lo:400:kworker.0 00010000:00010000:3.0:1788625141.837084:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625142.028547:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206133120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625142.028681:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625142.029075:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206133376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625142.029131:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625142.029161:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625142.029168:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206133248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625142.029205:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625142.029236:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206133120 00000100:00100000:2.0:1788625142.029243:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206133120 00000100:00100000:2.0:1788625142.029285:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206133376 00000100:00100000:2.0:1788625142.029288:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206133376 00000100:00100000:2.0:1788625142.029303:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788625142.029310:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206133120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788625142.029340:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625142.029383:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206133120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625142.029389:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788625142.029406:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788625142.029412:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206133376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625142.029422:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625142.029448:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206133376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625142.029453:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788625142.029468:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206133248 00000100:00100000:2.0:1788625142.029472:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206133248 00000100:00100000:2.0:1788625142.029495:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788625142.029501:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206133248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788625142.029551:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788625142.029581:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206133248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625142.029598:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1788625142.029647:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c61c00 x1875509206133120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625142.029664:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206133120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625142.029694:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206133248:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1788625142.029704:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844937480 x1875509206133376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625142.029713:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206133376:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1788625142.402980:0:10931:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing yml_node 00010000:00010000:0.0:1788625142.860152:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625143.883851:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625144.829346:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625144.829409:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625144.829451:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625144.829581:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185094656 00000100:00100000:3.0:1788625144.829595:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185094656 00000100:00100000:1.0:1788625144.829876:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 282 00000100:00100000:1.0:1788625144.829892:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2393:x1875509185094656:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625144.830002:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2393:x1875509185094656:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 115us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625144.830011:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 282 00000100:00100000:0.0:1788625144.830195:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185094912 00000100:00100000:0.0:1788625144.830201:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185094912 00000100:00100000:0.0:1788625144.830257:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185094784 00000100:00100000:0.0:1788625144.830333:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185094784 00000100:00100000:0.0:1788625144.830367:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 96 00000100:00100000:0.0:1788625144.830375:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185094912:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625144.830436:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185094912:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 62us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625144.830444:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 96 00000100:00100000:0.0:1788625144.830458:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 97 00000100:00100000:0.0:1788625144.830465:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185094784:12345-192.168.204.14@tcp:400:kworker.0 00000100:00080000:1.0:1788625144.831443:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625144.831462:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625144.831699:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185094784:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 1226us (2238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625144.831712:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 97 00010000:00010000:3.0:1788625144.907890:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625145.612396:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206133504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788625145.612480:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625145.612622:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206133504 00000100:00100000:0.0:1788625145.612638:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206133504 00000100:00100000:0.0:1788625145.612725:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788625145.612737:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206133504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625145.612914:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788625145.613928:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206133504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1188us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625145.613941:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000001:00100000:1.0:1788625145.616863:0:9503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000020:00000080:1.0:1788625145.616875:0:9503:0:(genops.c:885:class_export_put()) final put ffff99885ee8c000/1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000020:00000080:2.0:1788625145.616961:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99885ee8c000/1338b3dc-3f02-4b26-a9aa-7a14f6033224 for lustre-OST0001 00000020:00000080:2.0:1788625145.617026:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99885ee8a800 for lustre-OST0001 00000100:00100000:3.0:1788625145.621249:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206133504:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1788625145.622999:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000020:00000080:3.0:1788625145.623007:0:8419:0:(genops.c:885:class_export_put()) final put ffff99887f8c0800/1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000020:00000080:0.0:1788625145.623107:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99887f8c0800/1338b3dc-3f02-4b26-a9aa-7a14f6033224 for lustre-OST0000 00000020:00000080:0.0:1788625145.627908:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887f8c6800 for lustre-OST0000 00010000:00010000:0.0:1788625145.933729:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625146.123745:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206133632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788625146.123823:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625146.123889:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206133632 00000100:00100000:1.0:1788625146.123897:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206133632 00000100:00100000:1.0:1788625146.123941:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788625146.123949:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206133632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788625146.123976:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625146.124012:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206133632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625146.124019:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788625146.124037:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788625146.124061:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987438cea00 x1875509206133632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625146.124077:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206133632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625146.124486:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625146.131360:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206133760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625146.131432:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625146.132962:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206133760 00000100:00100000:0.0:1788625146.132974:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206133760 00000100:00100000:0.0:1788625146.133042:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788625146.133051:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206133760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625146.133075:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625146.133143:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206133760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625146.133164:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788625146.133218:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987438cea00 x1875509206133760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625146.133236:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206133760:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788625146.134958:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625146.636474:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206133888:0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.637121:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625146.637176:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206134400:0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.637203:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625146.637220:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206134912:0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.637242:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625146.637264:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788625146.637270:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206134272:0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.637286:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625146.637299:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206134784:0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.637315:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625146.637339:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206134016:0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.637372:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625146.637393:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206134528:0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.637414:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625146.637425:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206135040:0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.637451:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625146.637471:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788625146.637477:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206134144:0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.637509:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625146.637565:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206134656:0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.637602:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625146.637616:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206135168:0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.637636:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625146.637682:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206134400 00000100:00100000:0.0:1788625146.637689:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206134400 00000100:00100000:1.0:1788625146.637824:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206134912 00000100:00100000:1.0:1788625146.637828:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206134912 00000100:00100000:1.0:1788625146.637869:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206134272 00000100:00100000:1.0:1788625146.637871:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206134272 00000100:00100000:1.0:1788625146.637883:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206134784 00000100:00100000:1.0:1788625146.637885:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206134784 00000100:00100000:1.0:1788625146.637900:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206134016 00000100:00100000:1.0:1788625146.637903:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206134016 00000100:00100000:1.0:1788625146.637915:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206134528 00000100:00100000:1.0:1788625146.637924:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206134528 00000100:00100000:1.0:1788625146.637943:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206134656 00000100:00100000:1.0:1788625146.637945:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206134656 00000100:00100000:1.0:1788625146.637963:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788625146.637978:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206134912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625146.638044:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206134912:12345-0@lo:400:kworker.0 Request processed in 67us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625146.638051:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788625146.638068:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788625146.638073:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206134272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625146.638095:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206134272:12345-0@lo:400:kworker.0 Request processed in 22us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625146.638100:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788625146.638108:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788625146.638112:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206134784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625146.638129:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206134784:12345-0@lo:400:kworker.0 Request processed in 17us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625146.638134:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788625146.638140:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788625146.638144:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206134016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625146.638166:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206134016:12345-0@lo:400:kworker.0 Request processed in 21us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625146.638171:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788625146.638178:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788625146.638183:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206134528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625146.638200:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206134528:12345-0@lo:400:kworker.0 Request processed in 17us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625146.638210:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788625146.638218:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788625146.638222:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206134656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625146.638241:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206134656:12345-0@lo:400:kworker.0 Request processed in 19us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625146.638246:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1788625146.638268:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625146.638272:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625146.638734:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206134144 00000100:00100000:0.0:1788625146.638740:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206134144 00000100:00100000:0.0:1788625146.638751:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788625146.638757:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206134400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.638791:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206134400:12345-0@lo:400:kworker.0 Request processed in 35us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625146.638797:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788625146.638808:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788625146.638812:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206134144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.638831:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206134144:12345-0@lo:400:kworker.0 Request processed in 18us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625146.638835:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788625146.638851:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206135040 00000100:00100000:0.0:1788625146.638854:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206135040 00000100:00100000:0.0:1788625146.638880:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206135168 00000100:00100000:0.0:1788625146.638882:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206135168 00000100:00100000:0.0:1788625146.638898:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788625146.638904:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206135040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.638935:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206135040:12345-0@lo:400:kworker.0 Request processed in 31us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625146.638950:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788625146.638961:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788625146.638967:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206135168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.638996:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206135168:12345-0@lo:400:kworker.0 Request processed in 29us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625146.639001:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788625146.639028:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625146.639700:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206133888 00000100:00100000:3.0:1788625146.639707:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206133888 00000100:00100000:2.0:1788625146.639722:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206134272:0@lo:400:kworker.0 00000100:00100000:2.0:1788625146.639735:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206134784:0@lo:400:kworker.0 00000100:00100000:3.0:1788625146.639739:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788625146.639746:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206133888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625146.639746:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206134400:0@lo:400:kworker.0 00010000:00080000:2.0:1788625146.639759:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439f3800 x1875509206134912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625146.639768:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206134912:0@lo:400:kworker.0 00000100:00100000:2.0:1788625146.639794:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206133888:0@lo:400:kworker.0 00000100:00100000:3.0:1788625146.639795:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206133888:12345-0@lo:400:kworker.0 Request processed in 50us (2676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625146.639801:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788625146.639888:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206134144:0@lo:400:kworker.0 00010000:00080000:0.0:1788625146.639901:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439f3b80 x1875509206134656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625146.639910:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206134656:0@lo:400:kworker.0 00010000:00080000:0.0:1788625146.639919:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439f0000 x1875509206135168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625146.639927:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206135168:0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.639937:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206134016:0@lo:400:kworker.0 00000100:00100000:0.0:1788625146.639947:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206134528:0@lo:400:kworker.0 00010000:00080000:0.0:1788625146.639957:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439f2a00 x1875509206135040/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625146.639965:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206135040:0@lo:400:kworker.0 00000001:02000400:0.0:1788625146.653620:0:11115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:0.0:1788625146.956701:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625147.150153:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206135296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625147.150266:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625147.150346:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625147.150354:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206135424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625147.150383:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625147.150429:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206135296 00000100:00100000:2.0:1788625147.150438:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206135296 00000100:00100000:2.0:1788625147.150494:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788625147.150506:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206135296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788625147.150573:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625147.150628:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206135296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625147.150637:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788625147.150661:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206135424 00000100:00100000:2.0:1788625147.150665:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206135424 00000100:00100000:2.0:1788625147.150692:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788625147.150699:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206135424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788625147.150726:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788625147.150759:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206135424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625147.150765:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788625147.150812:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206135424:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1788625147.150825:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c61f80 x1875509206135296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625147.150840:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206135296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625147.154547:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625147.154579:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206135552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625147.154656:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625147.154704:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206135552 00000100:00100000:0.0:1788625147.154712:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206135552 00000100:00100000:0.0:1788625147.154767:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788625147.154775:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206135552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788625147.154799:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625147.154837:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206135552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625147.154844:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788625147.154885:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743976300 x1875509206135552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625147.154905:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206135552:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788625147.980930:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625149.009918:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788625149.034317:0:11212:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00000100:00100000:1.0:1788625149.949954:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625149.949999:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625149.950020:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625149.950098:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185095296 00000100:00100000:2.0:1788625149.950109:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185095296 00000100:00100000:2.0:1788625149.950191:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185095168 00000100:00100000:2.0:1788625149.950211:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185095168 00000100:00100000:2.0:1788625149.950240:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 104 00000100:00100000:2.0:1788625149.950249:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185095296:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625149.950310:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185095040 00000100:00100000:3.0:1788625149.950315:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185095040 00000100:00100000:3.0:1788625149.950346:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 284 00000100:00100000:3.0:1788625149.950353:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2394:x1875509185095040:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625149.950479:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 105 00000100:00100000:0.0:1788625149.950489:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185095168:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625149.950573:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185095296:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 324us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625149.950581:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 104 00000100:00080000:1.0:1788625149.950656:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625149.950660:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625149.955886:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2394:x1875509185095040:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 5518us (5929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625149.955902:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 284 00000100:00100000:0.0:1788625149.957059:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185095168:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 6562us (7027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625149.957071:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 105 00010000:00010000:0.0:1788625150.030342:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625150.732272:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206135680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625150.732567:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625150.732973:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206135680 00000100:00100000:2.0:1788625150.732985:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206135680 00000100:00100000:2.0:1788625150.733057:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788625150.733070:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206135680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788625150.733124:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788625150.733714:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206135680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 643us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625150.733726:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788625150.733839:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206135680:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788625151.052676:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625151.243773:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206135808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625151.243876:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625151.244007:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206135808 00000100:00100000:1.0:1788625151.244016:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206135808 00000100:00100000:1.0:1788625151.244085:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788625151.244097:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206135808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788625151.244134:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625151.244192:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206135808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625151.244200:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788625151.244300:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743831180 x1875509206135808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625151.244305:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206135936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625151.244350:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206135808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625151.244360:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625151.244747:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206135936 00000100:00100000:0.0:1788625151.244753:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206135936 00000100:00100000:0.0:1788625151.244792:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788625151.244802:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206135936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625151.244820:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625151.244866:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206135936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625151.244882:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788625151.244914:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743831c00 x1875509206135936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625151.244929:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206135936:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788625151.246569:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788625151.653742:0:11310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00000100:00100000:1.0:1788625151.755934:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206136064:0@lo:400:kworker.0 00000100:00100000:1.0:1788625151.756043:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625151.756106:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625151.756113:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206136192:0@lo:400:kworker.0 00000100:00100000:1.0:1788625151.756143:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625151.756383:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206136704:0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.756418:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625151.756448:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206137216:0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.756473:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625151.756492:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788625151.756498:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206136576:0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.756549:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625151.756570:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206137088:0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.756594:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625151.756629:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206136320:0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.756655:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625151.756674:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206136832:0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.756695:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625151.756710:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206137344:0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.756733:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625151.756753:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788625151.756883:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206136448:0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.756910:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625151.756923:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206136960:0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.756943:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625151.757062:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206136064 00000100:00100000:3.0:1788625151.757071:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206136064 00000100:00100000:2.0:1788625151.757082:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206136192 00000100:00100000:2.0:1788625151.757088:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206136192 00000100:00100000:2.0:1788625151.757119:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206136704 00000100:00100000:3.0:1788625151.757123:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788625151.757123:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206136704 00000100:00100000:3.0:1788625151.757137:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206136064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.757150:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206137088 00000100:00100000:2.0:1788625151.757154:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206137088 00000100:00100000:2.0:1788625151.757169:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206136832 00000100:00100000:2.0:1788625151.757172:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206136832 00000100:00100000:2.0:1788625151.757186:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206136448 00000100:00100000:2.0:1788625151.757188:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206136448 00000100:00100000:2.0:1788625151.757199:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206136960 00000100:00100000:2.0:1788625151.757202:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206136960 00000100:00100000:2.0:1788625151.757217:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788625151.757223:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206136192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.757259:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206136192:12345-0@lo:400:kworker.0 Request processed in 37us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625151.757267:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788625151.757296:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788625151.757302:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206136704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.757336:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206136704:12345-0@lo:400:kworker.0 Request processed in 34us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625151.757342:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788625151.757354:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788625151.757362:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206137088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625151.757466:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788625151.757475:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206136832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625151.757573:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206136064:12345-0@lo:400:kworker.0 Request processed in 439us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625151.757581:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788625151.759006:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788625151.759021:0:6512:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788625151.759043:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206136576 00000100:00100000:3.0:1788625151.759051:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206136576 00000100:00100000:3.0:1788625151.759937:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206136320 00000100:00100000:3.0:1788625151.759943:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206136320 00000100:00100000:3.0:1788625151.759960:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788625151.759969:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206136576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625151.760051:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206136576:12345-0@lo:400:kworker.0 Request processed in 83us (3500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625151.760058:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788625151.760074:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788625151.760080:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206136320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625151.760127:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206136320:12345-0@lo:400:kworker.0 Request processed in 48us (3471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625151.760133:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788625151.760153:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206137216 00000100:00100000:3.0:1788625151.760157:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206137216 00000100:00100000:3.0:1788625151.760931:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206137344 00000100:00100000:3.0:1788625151.760937:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206137344 00000100:00100000:3.0:1788625151.760963:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788625151.760970:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206137216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625151.761020:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206137216:12345-0@lo:400:kworker.0 Request processed in 51us (4545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625151.761027:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788625151.761039:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788625151.761045:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206137344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625151.761071:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206137344:12345-0@lo:400:kworker.0 Request processed in 26us (4337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625151.761092:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788625151.761114:0:9824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788625151.761123:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788625151.761129:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206136448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625151.761162:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206136448:12345-0@lo:400:kworker.0 Request processed in 33us (4251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625151.761571:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206137088:12345-0@lo:400:kworker.0 Request processed in 4209us (4974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625151.761582:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788625151.761603:0:9824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788625151.762082:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788625151.762104:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788625151.762113:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206136960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.762244:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206136960:12345-0@lo:400:kworker.0 Request processed in 133us (5299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625151.762251:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1788625151.762285:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625151.762291:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788625151.762294:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625151.762329:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206136576:0@lo:400:kworker.0 00010000:00080000:2.0:1788625151.762345:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987438cea00 x1875509206137088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625151.762356:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206137088:0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.762369:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206136704:0@lo:400:kworker.0 00010000:00080000:2.0:1788625151.762380:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439fc380 x1875509206137216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625151.762407:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206137216:0@lo:400:kworker.0 00000100:00100000:0.0:1788625151.762715:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206136448:0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.762723:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206136192:0@lo:400:kworker.0 00000100:00100000:0.0:1788625151.762734:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206136960:0@lo:400:kworker.0 00000100:00100000:2.0:1788625151.762743:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206136064:0@lo:400:kworker.0 00000100:00100000:0.0:1788625151.762753:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206136320:0@lo:400:kworker.0 00010000:00080000:0.0:1788625151.762767:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439ff100 x1875509206137344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625151.762776:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206137344:0@lo:400:kworker.0 00000100:00100000:1.0:1788625151.767075:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206136832:12345-0@lo:400:kworker.0 Request processed in 9590us (10367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625151.767090:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1788625151.767189:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bdc00 x1875509206136832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625151.767206:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206136832:0@lo:400:kworker.0 00010000:00010000:1.0:1788625152.077559:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625152.267892:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206137472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625152.267964:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625152.268259:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206137600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625152.268292:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625152.268380:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206137472 00000100:00100000:3.0:1788625152.268387:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206137472 00000100:00100000:3.0:1788625152.268446:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206137600 00000100:00100000:3.0:1788625152.268449:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206137600 00000100:00100000:3.0:1788625152.268465:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788625152.268474:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206137472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788625152.268503:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625152.268577:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206137472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625152.268584:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788625152.268601:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788625152.268607:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206137600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788625152.268616:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625152.268642:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206137600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625152.268649:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788625152.268985:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743976300 x1875509206137472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625152.269004:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206137472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625152.269065:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206137728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625152.269097:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625152.269189:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206137728 00000100:00100000:0.0:1788625152.269194:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206137728 00000100:00100000:0.0:1788625152.269229:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788625152.269235:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206137728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788625152.269258:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788625152.269299:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206137728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625152.269305:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788625152.269363:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206137728:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1788625152.269482:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c63b80 x1875509206137600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625152.269495:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206137600:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788625153.101111:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788625153.126026:0:11359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 12:19:10 EDT 2026 00010000:00010000:3.0:1788625154.123636:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625155.072772:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625155.072831:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625155.072866:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625155.072895:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185095552 00000100:00100000:2.0:1788625155.072895:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185095680 00000100:00100000:2.0:1788625155.072909:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185095680 00000100:00100000:3.0:1788625155.072910:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185095552 00000100:00100000:2.0:1788625155.072994:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 112 00000100:00100000:2.0:1788625155.073007:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2392:x1875509185095680:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625155.073085:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 113 00000100:00100000:3.0:1788625155.073096:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2392:x1875509185095552:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625155.073123:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185095424 00000100:00100000:1.0:1788625155.073129:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185095424 00000100:00100000:2.0:1788625155.073134:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2392:x1875509185095680:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 126us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625155.073144:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2392:x1875509185095552:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 51us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625155.073149:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 112 00000100:00100000:3.0:1788625155.073159:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 113 00000100:00100000:1.0:1788625155.073172:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 286 00000100:00100000:1.0:1788625155.073180:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2392:x1875509185095424:12345-192.168.204.14@tcp:400:kworker.0 00000100:00080000:2.0:1788625155.073186:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788625155.073193:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625155.073212:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2392:x1875509185095424:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 32us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625155.073253:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 286 00010000:00010000:1.0:1788625155.147794:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625155.854636:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206137856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625155.854722:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625155.854792:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206137856 00000100:00100000:0.0:1788625155.854799:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206137856 00000100:00100000:0.0:1788625155.854844:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788625155.854852:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206137856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625155.854886:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788625155.854928:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206137856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625155.854935:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788625155.854996:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206137856:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788625156.180501:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625156.363825:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625156.363849:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206137984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625156.363920:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625156.364333:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625156.364355:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206138112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625156.364398:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625156.364559:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206137984 00000100:00100000:1.0:1788625156.364567:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206137984 00000100:00100000:1.0:1788625156.364627:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206138112 00000100:00100000:1.0:1788625156.364631:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206138112 00000100:00100000:1.0:1788625156.364650:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788625156.364658:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206137984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788625156.364686:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625156.364735:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206137984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625156.364742:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788625156.364758:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788625156.364765:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206138112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625156.364775:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625156.364803:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206138112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625156.364809:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788625156.364845:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c2b480 x1875509206138112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625156.364862:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206138112:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788625156.364891:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743831c00 x1875509206137984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625156.364903:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206137984:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788625156.365192:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625156.877822:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206138368:0@lo:400:kworker.0 00000100:00100000:0.0:1788625156.877913:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625156.877965:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206138880:0@lo:400:kworker.0 00000100:00100000:0.0:1788625156.877996:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625156.878018:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206139392:0@lo:400:kworker.0 00000100:00100000:0.0:1788625156.878069:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625156.878100:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788625156.878107:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206138496:0@lo:400:kworker.0 00000100:00100000:0.0:1788625156.878131:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625156.878149:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206139008:0@lo:400:kworker.0 00000100:00100000:0.0:1788625156.878180:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625156.878199:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206139520:0@lo:400:kworker.0 00000100:00100000:0.0:1788625156.878218:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625156.878252:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206139392 00000100:00100000:0.0:1788625156.878261:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206139392 00000100:00100000:0.0:1788625156.878319:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206139520 00000100:00100000:0.0:1788625156.878322:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206139520 00000100:00100000:0.0:1788625156.878362:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788625156.878372:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206139392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625156.878428:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206139392:12345-0@lo:400:kworker.0 Request processed in 59us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625156.878434:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788625156.878450:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788625156.878457:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206139520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.879227:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206138624:0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.879271:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625156.879298:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206139136:0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.879318:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625156.879352:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788625156.879359:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206138240:0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.879386:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625156.879423:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206138752:0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.879446:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625156.879467:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206139264:0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.879487:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625156.879510:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206138368 00000100:00100000:3.0:1788625156.879649:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206138368 00000100:00100000:3.0:1788625156.879677:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206138880 00000100:00100000:3.0:1788625156.879680:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206138880 00000100:00100000:3.0:1788625156.879695:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206139008 00000100:00100000:3.0:1788625156.879697:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206139008 00000100:00100000:3.0:1788625156.879708:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206138624 00000100:00100000:3.0:1788625156.879710:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206138624 00000100:00100000:3.0:1788625156.879720:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206139136 00000100:00100000:3.0:1788625156.879722:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206139136 00000100:00100000:3.0:1788625156.879732:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206139264 00000100:00100000:3.0:1788625156.879735:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206139264 00000100:00100000:3.0:1788625156.879748:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788625156.879756:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206138368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.879798:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206138368:12345-0@lo:400:kworker.0 Request processed in 43us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625156.879804:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788625156.879819:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788625156.879825:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206138880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.879852:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206138880:12345-0@lo:400:kworker.0 Request processed in 28us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625156.879857:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788625156.879881:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788625156.879887:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206139008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.879914:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206139008:12345-0@lo:400:kworker.0 Request processed in 28us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625156.879920:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788625156.879930:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788625156.879935:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206138624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.879993:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206138624:12345-0@lo:400:kworker.0 Request processed in 57us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625156.879999:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788625156.880012:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788625156.880018:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206139136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.880044:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206139136:12345-0@lo:400:kworker.0 Request processed in 27us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625156.880050:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788625156.880061:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788625156.880067:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206139264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.880092:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206139264:12345-0@lo:400:kworker.0 Request processed in 26us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625156.880098:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788625156.880124:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206138496 00000100:00100000:3.0:1788625156.880128:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206138496 00000100:00100000:3.0:1788625156.880145:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206138752 00000100:00100000:3.0:1788625156.880147:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206138752 00000100:00100000:3.0:1788625156.880158:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788625156.880164:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206138496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.880196:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206138496:12345-0@lo:400:kworker.0 Request processed in 31us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625156.880202:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788625156.880212:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788625156.880218:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206138752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.880243:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206138752:12345-0@lo:400:kworker.0 Request processed in 25us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625156.880257:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788625156.880292:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206138752:0@lo:400:kworker.0 00010000:00080000:3.0:1788625156.880305:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743977100 x1875509206139264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625156.880316:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206139264:0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.880326:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206138624:0@lo:400:kworker.0 00000100:00100000:3.0:1788625156.880350:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206139136:0@lo:400:kworker.0 00000100:00080000:1.0:1788625156.880564:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625156.880575:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625156.880577:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625156.880670:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206138240 00000100:00100000:2.0:1788625156.880675:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206138240 00000100:00100000:2.0:1788625156.880705:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788625156.880712:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206138240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625156.880768:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206138240:12345-0@lo:400:kworker.0 Request processed in 56us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625156.880775:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788625156.880853:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206138240:0@lo:400:kworker.0 00000100:00100000:0.0:1788625156.881506:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206139520:12345-0@lo:400:kworker.0 Request processed in 3048us (3285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625156.881534:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788625156.881579:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206138496:0@lo:400:kworker.0 00010000:00080000:0.0:1788625156.881593:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743976a00 x1875509206139008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625156.881755:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206139008:0@lo:400:kworker.0 00010000:00080000:0.0:1788625156.881771:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743974380 x1875509206139520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625156.881779:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206139520:0@lo:400:kworker.0 00000100:00100000:0.0:1788625156.881790:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206138368:0@lo:400:kworker.0 00000100:00100000:0.0:1788625156.881813:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206138880:0@lo:400:kworker.0 00010000:00080000:0.0:1788625156.881825:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743977480 x1875509206139392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625156.881833:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206139392:0@lo:400:kworker.0 00010000:00010000:3.0:1788625157.195798:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625157.387749:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206139648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625157.387829:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625157.388506:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206139648 00000100:00100000:0.0:1788625157.388542:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206139648 00000100:00100000:0.0:1788625157.388602:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788625157.388607:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206139776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625157.388611:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206139648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625157.388642:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625157.388648:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625157.388686:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206139648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625157.388692:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788625157.388721:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206139776 00000100:00100000:0.0:1788625157.388725:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206139776 00000100:00100000:0.0:1788625157.388756:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788625157.388763:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206139776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788625157.388785:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00010000:00080000:2.0:1788625157.389007:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c61f80 x1875509206139648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625157.389028:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206139648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625157.389229:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206139904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625157.389269:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625157.389337:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206139904 00000100:00100000:2.0:1788625157.389342:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206139904 00000100:00100000:2.0:1788625157.389368:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788625157.389375:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206139904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625157.389386:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625157.389418:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206139904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625157.389424:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788625157.390189:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bdc00 x1875509206139904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625157.390205:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206139904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625157.396040:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206139776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7264us (7378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625157.396059:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788625157.396654:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206139776:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788625158.219697:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625159.245022:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625160.207304:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625160.207354:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625160.207391:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625160.207462:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185095808 00000100:00100000:0.0:1788625160.207473:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185095808 00000100:00100000:0.0:1788625160.207552:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 288 00000100:00100000:0.0:1788625160.207563:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2393:x1875509185095808:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625160.207665:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2393:x1875509185095808:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 104us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625160.207674:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 288 00000100:00100000:3.0:1788625160.208134:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185095936 00000100:00100000:3.0:1788625160.208140:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185095936 00000100:00100000:3.0:1788625160.208208:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185096064 00000100:00100000:3.0:1788625160.208211:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185096064 00000100:00100000:3.0:1788625160.208235:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 120 00000100:00100000:3.0:1788625160.208242:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185095936:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625160.208302:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185095936:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 61us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625160.208309:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 120 00000100:00100000:3.0:1788625160.208323:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 121 00000100:00100000:3.0:1788625160.208330:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185096064:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625160.208362:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185096064:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 33us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625160.208368:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 121 00000100:00080000:1.0:1788625160.208794:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625160.208799:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788625160.267694:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625160.974901:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625160.974927:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206140032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788625160.975012:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625160.975263:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206140032 00000100:00100000:0.0:1788625160.975272:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206140032 00000100:00100000:0.0:1788625160.975333:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788625160.975344:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206140032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625160.975379:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788625160.975441:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206140032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625160.975450:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788625160.975495:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206140032:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788625161.300983:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625161.484023:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625161.490913:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206140288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625161.490997:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625161.496353:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206140160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625161.496442:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625161.515501:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206140288 00000100:00100000:1.0:1788625161.515531:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206140288 00000100:00080000:1.0:1788625161.515573:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625161.515627:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206140160 00000100:00100000:1.0:1788625161.515630:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206140160 00000100:00100000:1.0:1788625161.515657:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788625161.515668:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206140288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625161.515704:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625161.515806:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206140288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (24808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625161.515814:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788625161.515830:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788625161.515845:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206140160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788625161.515855:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625161.515883:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206140160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (19441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625161.515890:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788625161.515907:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788625161.515910:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bc700 x1875509206140288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625161.515937:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206140288:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788625161.516837:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c2b800 x1875509206140160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625161.516854:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206140160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625161.995866:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206140800:0@lo:400:kworker.0 00000100:00100000:3.0:1788625161.995954:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625161.996009:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206141312:0@lo:400:kworker.0 00000100:00100000:3.0:1788625161.996033:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625161.996056:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206141824:0@lo:400:kworker.0 00000100:00100000:3.0:1788625161.996076:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625161.996098:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788625161.996104:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206140672:0@lo:400:kworker.0 00000100:00100000:3.0:1788625161.996127:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625161.996143:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206141184:0@lo:400:kworker.0 00000100:00100000:3.0:1788625161.996161:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625161.996178:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206141696:0@lo:400:kworker.0 00000100:00100000:3.0:1788625161.996198:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625161.996244:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206140800 00000100:00100000:3.0:1788625161.996251:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206140800 00000100:00100000:3.0:1788625161.996309:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206141184 00000100:00100000:3.0:1788625161.996326:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206141184 00000100:00100000:3.0:1788625161.996356:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206141696 00000100:00100000:3.0:1788625161.996359:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206141696 00000100:00100000:3.0:1788625161.996376:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788625161.996384:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206140800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625161.996440:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206140800:12345-0@lo:400:kworker.0 Request processed in 56us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625161.996447:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788625161.996465:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788625161.996471:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206141184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625161.996496:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206141184:12345-0@lo:400:kworker.0 Request processed in 26us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625161.996503:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788625161.996513:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788625161.996555:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206141696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625161.996583:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206141696:12345-0@lo:400:kworker.0 Request processed in 30us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625161.996589:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788625161.996608:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206141312 00000100:00100000:3.0:1788625161.996612:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206141312 00000100:00100000:3.0:1788625161.996631:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206141824 00000100:00100000:3.0:1788625161.996634:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206141824 00000100:00100000:3.0:1788625161.996650:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788625161.996656:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206141312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625161.996686:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206141312:12345-0@lo:400:kworker.0 Request processed in 31us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625161.996693:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788625161.996711:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788625161.996716:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206141824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625161.996743:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206141824:12345-0@lo:400:kworker.0 Request processed in 28us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625161.996750:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788625161.996774:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625161.996778:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788625161.996878:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743975180 x1875509206141184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625161.996893:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206141184:0@lo:400:kworker.0 00010000:00080000:3.0:1788625161.996904:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743aec380 x1875509206141696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625161.996912:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206141696:0@lo:400:kworker.0 00000100:00100000:3.0:1788625161.996921:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206140800:0@lo:400:kworker.0 00010000:00080000:3.0:1788625161.996929:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743977800 x1875509206141312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625161.996938:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206141312:0@lo:400:kworker.0 00010000:00080000:3.0:1788625161.996946:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743aedf80 x1875509206141824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625161.996953:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206141824:0@lo:400:kworker.0 00000100:00100000:1.0:1788625161.997247:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206140544:0@lo:400:kworker.0 00000100:00100000:1.0:1788625161.997299:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625161.997303:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206140416:0@lo:400:kworker.0 00000100:00100000:1.0:1788625161.997324:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206141056:0@lo:400:kworker.0 00000100:00100000:0.0:1788625161.997336:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625161.997344:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625161.997369:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206141568:0@lo:400:kworker.0 00000100:00100000:1.0:1788625161.997393:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625161.997584:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206140544 00000100:00100000:1.0:1788625161.997589:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206140544 00000100:00100000:1.0:1788625161.997614:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206141056 00000100:00100000:1.0:1788625161.997617:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206141056 00000100:00100000:1.0:1788625161.997632:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206141568 00000100:00100000:1.0:1788625161.997634:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206141568 00000100:00100000:1.0:1788625161.997648:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788625161.997654:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206140544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625161.997695:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206140544:12345-0@lo:400:kworker.0 Request processed in 40us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625161.997702:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788625161.997725:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788625161.997731:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206141056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625161.997758:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206141056:12345-0@lo:400:kworker.0 Request processed in 27us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625161.997764:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788625161.997774:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788625161.997780:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206141568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625161.997802:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206141568:12345-0@lo:400:kworker.0 Request processed in 23us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625161.997809:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788625161.997827:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206140672 00000100:00100000:1.0:1788625161.997831:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206140672 00000100:00100000:1.0:1788625161.997852:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788625161.997858:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206140672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625161.997890:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206140672:12345-0@lo:400:kworker.0 Request processed in 32us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625161.997896:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788625161.997945:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206140544:0@lo:400:kworker.0 00000100:00100000:1.0:1788625161.997956:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206141056:0@lo:400:kworker.0 00000100:00100000:1.0:1788625161.997965:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206141568:0@lo:400:kworker.0 00000100:00080000:3.0:1788625161.999723:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625161.999774:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206140672:0@lo:400:kworker.0 00000100:00100000:0.0:1788625162.001549:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206140928:0@lo:400:kworker.0 00000100:00100000:0.0:1788625162.001627:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625162.001664:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206141440:0@lo:400:kworker.0 00000100:00100000:0.0:1788625162.001685:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625162.001704:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206141952:0@lo:400:kworker.0 00000100:00100000:1.0:1788625162.001714:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206141440 00000100:00100000:1.0:1788625162.001723:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206141440 00000100:00100000:0.0:1788625162.001723:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625162.001769:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206141952 00000100:00100000:1.0:1788625162.001772:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206141952 00000100:00100000:0.0:1788625162.001778:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206140416 00000100:00100000:0.0:1788625162.001781:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206140416 00000100:00100000:1.0:1788625162.001799:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788625162.001809:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206141440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625162.001816:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788625162.001822:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3637:x1875509206140416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625162.001874:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206141440:12345-0@lo:400:kworker.0 Request processed in 66us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625162.001882:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788625162.001900:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788625162.001907:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206141952:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788625162.001998:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625162.002019:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206140928 00000100:00100000:3.0:1788625162.002023:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206140928 00000100:00100000:3.0:1788625162.002050:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788625162.002056:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206140928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625162.002116:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3637:x1875509206140416:12345-0@lo:400:kworker.0 Request processed in 293us (4777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625162.002124:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788625162.002179:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206140416:0@lo:400:kworker.0 00000100:00100000:1.0:1788625162.003996:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206141952:12345-0@lo:400:kworker.0 Request processed in 2080us (2261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625162.004009:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788625162.011549:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206140928:12345-0@lo:400:kworker.0 Request processed in 9458us (9887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625162.011568:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788625162.017713:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206140928:0@lo:400:kworker.0 00010000:00080000:0.0:1788625162.017737:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743977100 x1875509206141440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625162.017749:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206141440:0@lo:400:kworker.0 00010000:00080000:0.0:1788625162.017762:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743aed880 x1875509206141952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625162.017770:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206141952:0@lo:400:kworker.0 00010000:00010000:0.0:1788625162.316983:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625162.508443:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206142080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625162.508537:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625162.508629:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206142080 00000100:00100000:2.0:1788625162.508637:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206142080 00000100:00100000:2.0:1788625162.508684:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788625162.508693:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206142080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625162.508724:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625162.508786:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206142080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625162.508794:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788625162.508833:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bc380 x1875509206142080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625162.508854:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206142080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625162.509107:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206142208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625162.509140:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625162.509230:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206142208 00000100:00100000:0.0:1788625162.509241:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206142208 00000100:00100000:0.0:1788625162.509275:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788625162.509284:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206142208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625162.509297:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625162.509330:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206142208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625162.509337:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788625162.509397:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743ad7800 x1875509206142208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625162.509411:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206142208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625162.515181:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625162.515231:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206142336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625162.515308:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625162.515404:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206142336 00000100:00100000:1.0:1788625162.515413:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206142336 00000100:00100000:1.0:1788625162.515469:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788625162.515479:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206142336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625162.515512:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788625162.515587:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206142336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625162.515594:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788625162.515639:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206142336:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788625163.339677:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625164.364692:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625165.312036:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625165.312073:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185096192 00000100:00100000:1.0:1788625165.312082:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625165.312085:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185096192 00000100:00100000:3.0:1788625165.312148:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 290 00000100:00100000:1.0:1788625165.312153:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625165.312174:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2394:x1875509185096192:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625165.313055:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185096448 00000100:00100000:0.0:1788625165.313063:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185096448 00000100:00100000:0.0:1788625165.313151:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185096320 00000100:00100000:0.0:1788625165.313155:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185096320 00000100:00100000:0.0:1788625165.313314:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 128 00000100:00100000:0.0:1788625165.313327:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185096448:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625165.313386:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185096448:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 61us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625165.313393:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 128 00000100:00100000:0.0:1788625165.313414:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 129 00000100:00100000:0.0:1788625165.313423:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185096320:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625165.313455:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185096320:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 33us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625165.313461:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 129 00000100:00080000:1.0:1788625165.313604:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625165.313608:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625165.319959:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2394:x1875509185096192:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 7784us (7920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625165.319976:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 290 00010000:00010000:1.0:1788625165.394630:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625166.092738:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625166.092760:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206142464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625166.092827:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625166.092899:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206142464 00000100:00100000:2.0:1788625166.092909:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206142464 00000100:00100000:2.0:1788625166.092958:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788625166.092966:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206142464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788625166.093004:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788625166.093048:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206142464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625166.093054:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788625166.093101:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206142464:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788625166.416823:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625166.608807:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206142592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625166.608880:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625166.608944:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206142720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788625166.608967:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625166.609000:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206142592 00000100:00100000:1.0:1788625166.609008:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206142592 00000100:00100000:1.0:1788625166.609056:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206142720 00000100:00100000:1.0:1788625166.609059:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206142720 00000100:00100000:1.0:1788625166.609074:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788625166.609082:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206142592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625166.609110:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625166.609166:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206142592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625166.609174:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788625166.609190:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788625166.609197:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206142720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788625166.609207:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625166.610685:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206142720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1482us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625166.610696:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788625166.610725:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788625166.610904:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99885eec7b80 x1875509206142592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625166.610934:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206142592:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788625166.611375:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9988449ace00 x1875509206142720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625166.611391:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206142720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625167.118242:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206142976:0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.118335:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625167.118412:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206143488:0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.118446:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625167.118472:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206144000:0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.118492:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625167.118545:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788625167.118552:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206143104:0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.118594:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625167.118615:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206143616:0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.118635:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625167.118650:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206144128:0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.118667:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625167.118696:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206142976 00000100:00100000:0.0:1788625167.118705:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206142976 00000100:00100000:0.0:1788625167.118744:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206143488 00000100:00100000:0.0:1788625167.118747:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206143488 00000100:00100000:0.0:1788625167.118767:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206144000 00000100:00100000:0.0:1788625167.118770:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206144000 00000100:00100000:0.0:1788625167.118783:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206143616 00000100:00100000:0.0:1788625167.118786:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206143616 00000100:00100000:0.0:1788625167.118797:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206144128 00000100:00100000:0.0:1788625167.118799:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206144128 00000100:00100000:0.0:1788625167.118815:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788625167.118823:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206142976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.118880:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206142976:12345-0@lo:400:kworker.0 Request processed in 56us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625167.118887:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788625167.118902:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788625167.118908:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206143488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.118933:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206143488:12345-0@lo:400:kworker.0 Request processed in 26us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625167.118939:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788625167.118948:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788625167.118954:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206144000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.118993:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206144000:12345-0@lo:400:kworker.0 Request processed in 39us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625167.119000:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788625167.119012:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788625167.119018:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206143616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.119043:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206143616:12345-0@lo:400:kworker.0 Request processed in 26us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625167.119050:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788625167.119060:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788625167.119066:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206144128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.119092:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206144128:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625167.119098:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788625167.119132:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206143104 00000100:00100000:0.0:1788625167.119136:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206143104 00000100:00100000:0.0:1788625167.119165:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788625167.119172:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206143104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.119218:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206143104:12345-0@lo:400:kworker.0 Request processed in 47us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625167.119224:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788625167.119279:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206143104:0@lo:400:kworker.0 00010000:00080000:0.0:1788625167.119293:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844934e00 x1875509206143616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625167.119302:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206143616:0@lo:400:kworker.0 00010000:00080000:0.0:1788625167.119321:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743a75c00 x1875509206144128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625167.119329:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206144128:0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.119338:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206142976:0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.119346:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206143488:0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.119355:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206144000:0@lo:400:kworker.0 00000100:00100000:3.0:1788625167.119793:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206143232:0@lo:400:kworker.0 00000100:00100000:3.0:1788625167.119833:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625167.119877:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206143744:0@lo:400:kworker.0 00000100:00100000:3.0:1788625167.119900:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625167.119930:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206144256:0@lo:400:kworker.0 00000100:00100000:3.0:1788625167.119949:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625167.119967:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788625167.119972:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206142848:0@lo:400:kworker.0 00000100:00100000:3.0:1788625167.119998:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625167.120022:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206143360:0@lo:400:kworker.0 00000100:00100000:3.0:1788625167.120043:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625167.120068:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206143872:0@lo:400:kworker.0 00000100:00100000:3.0:1788625167.120090:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625167.120118:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206144384:0@lo:400:kworker.0 00000100:00100000:3.0:1788625167.120151:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625167.120178:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206142848 00000100:00100000:3.0:1788625167.120183:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206142848 00000100:00100000:3.0:1788625167.120224:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788625167.120232:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206142848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625167.120270:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206142848:12345-0@lo:400:kworker.0 Request processed in 39us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625167.120276:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788625167.120328:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206142848:0@lo:400:kworker.0 00000100:00100000:2.0:1788625167.120614:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206143744 00000100:00100000:2.0:1788625167.120619:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206143744 00000100:00100000:2.0:1788625167.120644:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206144256 00000100:00100000:2.0:1788625167.120647:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206144256 00000100:00100000:2.0:1788625167.120662:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206143872 00000100:00100000:2.0:1788625167.120672:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206143872 00000100:00100000:2.0:1788625167.120686:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206144384 00000100:00100000:2.0:1788625167.120688:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206144384 00000100:00100000:2.0:1788625167.120702:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788625167.120708:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206143744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625167.120759:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206143744:12345-0@lo:400:kworker.0 Request processed in 51us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625167.120765:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788625167.120779:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788625167.120785:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206144256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625167.120813:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206144256:12345-0@lo:400:kworker.0 Request processed in 28us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625167.120818:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788625167.120829:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788625167.120834:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206143872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625167.120861:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206143872:12345-0@lo:400:kworker.0 Request processed in 27us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625167.120867:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788625167.120877:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788625167.120882:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206144384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625167.120906:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206144384:12345-0@lo:400:kworker.0 Request processed in 24us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625167.120911:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788625167.121164:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625167.121170:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625167.121173:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788625167.121741:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743a74380 x1875509206143872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625167.121757:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206143872:0@lo:400:kworker.0 00010000:00080000:3.0:1788625167.121770:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743a76300 x1875509206144384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625167.121779:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206144384:0@lo:400:kworker.0 00010000:00080000:3.0:1788625167.121792:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743a77480 x1875509206143744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625167.121800:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206143744:0@lo:400:kworker.0 00010000:00080000:3.0:1788625167.121812:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743a74000 x1875509206144256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625167.121820:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206144256:0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.121944:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206143360 00000100:00100000:0.0:1788625167.121951:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206143360 00000100:00100000:0.0:1788625167.121999:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788625167.122007:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206143360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.122084:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206143360:12345-0@lo:400:kworker.0 Request processed in 79us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625167.122096:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788625167.122137:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206143232 00000100:00100000:0.0:1788625167.122141:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206143232 00000100:00100000:0.0:1788625167.122175:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788625167.122181:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206143232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625167.122442:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206143360:0@lo:400:kworker.0 00000100:00100000:0.0:1788625167.122601:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206143232:12345-0@lo:400:kworker.0 Request processed in 420us (2768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625167.122609:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788625167.122823:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206143232:0@lo:400:kworker.0 00010000:00010000:1.0:1788625167.439549:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625167.627956:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206144512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625167.628071:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625167.628458:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206144512 00000100:00100000:2.0:1788625167.628471:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206144512 00000100:00100000:2.0:1788625167.628568:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788625167.628581:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206144512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625167.628641:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625167.629002:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206144512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 423us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625167.629011:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788625167.629548:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206144768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625167.629589:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625167.629674:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206144768 00000100:00100000:0.0:1788625167.629680:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206144768 00000100:00100000:0.0:1788625167.629903:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788625167.629911:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206144768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625167.629928:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625167.630659:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206144768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 744us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625167.630668:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788625167.631477:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743ad5c00 x1875509206144768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625167.631503:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206144768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625167.631630:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206144640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625167.631690:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625167.632108:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206144640 00000100:00100000:0.0:1788625167.632127:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206144640 00000100:00100000:0.0:1788625167.632208:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788625167.632217:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206144640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788625167.632254:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788625167.632314:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206144640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625167.632321:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788625167.632398:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206144640:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1788625167.636810:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743a75f80 x1875509206144512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625167.636845:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206144512:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788625168.462984:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788625168.741052:0:11988:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:19:26 (1788625166) === 00000100:00100000:1.0:1788625169.174563:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625169.180481:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185096576 00000100:00100000:3.0:1788625169.180498:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185096576 00000100:00100000:3.0:1788625169.180678:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 292 00000100:00100000:3.0:1788625169.180690:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:8734:x1875509185096576:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788625169.180707:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625169.180726:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a3c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3dfaa expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625169.180758:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a3c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfaa expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625169.180770:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a3c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfaa expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625169.180780:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682400, rc 0) 00000100:00100000:3.0:1788625169.180854:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:8734:x1875509185096576:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 166us (6299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625169.180862:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 292 00000100:00100000:0.0:1788625169.186272:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625169.186404:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185096704 00000100:00100000:2.0:1788625169.186416:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185096704 00000100:00100000:2.0:1788625169.186511:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 293 00000100:00100000:2.0:1788625169.186578:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:8734:x1875509185096704:12345-192.168.204.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788625169.186763:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:8734:x1875509185096704:12345-192.168.204.14@tcp:501:mount.lustre.0 Request processed in 189us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625169.186771:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 293 00000100:00100000:1.0:1788625169.189444:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625169.189701:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185096832 00000100:00100000:3.0:1788625169.189711:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185096832 00000100:00100000:3.0:1788625169.189768:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 294 00000100:00100000:3.0:1788625169.189800:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:8734:x1875509185096832:12345-192.168.204.14@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788625169.189960:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:8734:x1875509185096832:12345-192.168.204.14@tcp:503:mount.lustre.0 Request processed in 163us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625169.189969:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 294 00000100:00100000:3.0:1788625169.197296:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625169.197558:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185096960 00000100:00100000:1.0:1788625169.197570:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185096960 00000100:00100000:1.0:1788625169.197635:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 295 00000100:00100000:1.0:1788625169.197648:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:8738:x1875509185096960:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788625169.197812:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:8738:x1875509185096960:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 166us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625169.197822:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 295 00000100:00100000:1.0:1788625169.230111:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625169.230319:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185097088 00000100:00100000:0.0:1788625169.230330:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185097088 00000100:00100000:0.0:1788625169.230436:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 296 00000100:00100000:0.0:1788625169.230446:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:8738:x1875509185097088:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625169.232223:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:8738:x1875509185097088:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 1770us (2115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625169.232236:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 296 00000100:00100000:0.0:1788625169.243074:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625169.243192:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185097216 00000100:00100000:2.0:1788625169.243202:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185097216 00000100:00100000:2.0:1788625169.243259:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 297 00000100:00100000:2.0:1788625169.243269:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:8738:x1875509185097216:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788625169.243427:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:8738:x1875509185097216:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 158us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625169.243436:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 297 00000100:00100000:3.0:1788625169.246352:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625169.246852:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185097344 00000100:00100000:0.0:1788625169.246865:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185097344 00000100:00100000:0.0:1788625169.246933:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 298 00000100:00100000:0.0:1788625169.246944:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:8734:x1875509185097344:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788625169.246962:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625169.246983:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c995600/0x2d2e3b3f34a7a3c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3dfdb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625169.247015:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c995600/0x2d2e3b3f34a7a3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfdb expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625169.247026:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c995600/0x2d2e3b3f34a7a3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfdb expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625169.247035:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995600, rc 0) 00000100:00100000:0.0:1788625169.247107:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:8734:x1875509185097344:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 163us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625169.247114:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 298 00000100:00100000:0.0:1788625169.252491:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625169.255461:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185097472 00000100:00100000:1.0:1788625169.255477:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185097472 00000100:00100000:0.0:1788625169.258132:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 299 00000100:00100000:0.0:1788625169.258145:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:8734:x1875509185097472:12345-192.168.204.14@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788625169.258174:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788625169.258201:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788625169.258206:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788625169.258209:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788625169.258212:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788625169.258214:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788625169.262372:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:8734:x1875509185097472:12345-192.168.204.14@tcp:256:mount.lustre.0 Request processed in 4217us (9878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625169.262388:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 299 00000100:00100000:1.0:1788625169.266869:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625169.272751:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185097600 00000100:00100000:2.0:1788625169.272767:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185097600 00000100:00100000:2.0:1788625169.272842:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 300 00000100:00100000:2.0:1788625169.272852:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:8734:x1875509185097600:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788625169.272868:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625169.272900:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a3d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3dfe2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625169.272929:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a3d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfe2 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625169.272940:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a3d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfe2 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625169.272949:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6000, rc 0) 00000100:00100000:2.0:1788625169.273094:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:8734:x1875509185097600:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 244us (6235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625169.273101:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 300 00000100:00100000:1.0:1788625169.282950:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625169.283026:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185097728 00000100:00100000:0.0:1788625169.283037:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185097728 00000100:00100000:0.0:1788625169.283103:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 301 00000100:00100000:0.0:1788625169.283114:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:8734:x1875509185097728:12345-192.168.204.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788625169.283337:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:8734:x1875509185097728:12345-192.168.204.14@tcp:501:mount.lustre.0 Request processed in 224us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625169.283346:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 301 00000100:00100000:1.0:1788625169.289634:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625169.289832:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185097856 00000100:00100000:3.0:1788625169.289843:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185097856 00000100:00100000:3.0:1788625169.289903:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 302 00000100:00100000:3.0:1788625169.289914:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:8734:x1875509185097856:12345-192.168.204.14@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788625169.290131:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:8734:x1875509185097856:12345-192.168.204.14@tcp:503:mount.lustre.0 Request processed in 218us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625169.290139:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 302 00000100:00100000:1.0:1788625169.297791:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625169.297925:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185097984 00000100:00100000:2.0:1788625169.297935:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185097984 00000100:00100000:2.0:1788625169.297992:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 303 00000100:00100000:2.0:1788625169.298002:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:8742:x1875509185097984:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788625169.298173:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:8742:x1875509185097984:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 171us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625169.298181:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 303 00000100:00100000:1.0:1788625169.311279:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625169.311434:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185098112 00000100:00100000:0.0:1788625169.311445:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185098112 00000100:00100000:0.0:1788625169.311512:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 304 00000100:00100000:0.0:1788625169.311559:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:8742:x1875509185098112:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625169.311745:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:8742:x1875509185098112:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 188us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625169.311753:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 304 00000100:00100000:1.0:1788625169.316994:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625169.317045:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625169.317100:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625169.317351:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185098368 00000100:00100000:0.0:1788625169.317363:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185098368 00000100:00100000:0.0:1788625169.317441:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185098496 00000100:00100000:0.0:1788625169.317444:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185098496 00000100:00100000:0.0:1788625169.317464:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185098240 00000100:00100000:0.0:1788625169.317467:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185098240 00000100:00100000:0.0:1788625169.317483:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 136 00000100:00100000:0.0:1788625169.317493:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2391:x1875509185098368:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625169.317622:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2391:x1875509185098368:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 129us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625169.317649:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 136 00000100:00100000:0.0:1788625169.317668:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 137 00000100:00100000:0.0:1788625169.317675:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185098496:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625169.317703:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185098496:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 28us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625169.317709:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 137 00000100:00100000:0.0:1788625169.317720:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:0.0:1788625169.317723:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2390:x1875509185098240:12345-192.168.204.14@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788625169.317746:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 44e8506e-584d-40a5-8ecc-bc286c2e90c7@192.168.204.14@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:0.0:1788625169.317985:0:6512:0:(genops.c:1385:class_connect()) connect: client 44e8506e-584d-40a5-8ecc-bc286c2e90c7, cookie 0x2d2e3b3f34a7a3d7 00000004:00100000:0.0:1788625169.318012:0:6512:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788625169.318194:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9987438d2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625169.318407:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2390:x1875509185098240:12345-192.168.204.14@tcp:38:mount.lustre.0 Request processed in 680us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625169.318416:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00080000:1.0:1788625169.319104:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625169.319110:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625169.335806:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625169.335909:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625169.340840:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625169.349197:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185098752 00000100:00100000:1.0:1788625169.349197:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185098624 00000100:00100000:1.0:1788625169.349211:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185098624 00000100:00080000:3.0:1788625169.349360:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625169.349570:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:1.0:1788625169.349582:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:0:x1875509185098624:12345-192.168.204.14@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788625169.349624:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788625169.349726:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:0:x1875509185098624:12345-192.168.204.14@tcp:41:mount.lustre.0 Request processed in 145us (13816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625169.349734:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:2.0:1788625169.349787:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185098752 00000100:00100000:3.0:1788625169.350207:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:3.0:1788625169.350214:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1875509185098752:12345-192.168.204.14@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788625169.350244:0:9824:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 44e8506e-584d-40a5-8ecc-bc286c2e90c7@192.168.204.14@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:3.0:1788625169.350866:0:9824:0:(genops.c:1385:class_connect()) connect: client 44e8506e-584d-40a5-8ecc-bc286c2e90c7, cookie 0x2d2e3b3f34a7a3de 00000004:00100000:3.0:1788625169.350897:0:9824:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788625169.351026:0:9824:0:(import.c:65:import_set_state_nolock()) ffff99874383c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625169.351094:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2390:x1875509185098752:12345-192.168.204.14@tcp:38:mount.lustre.0 Request processed in 879us (15300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625169.351102:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:1.0:1788625169.352599:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185099008 00000100:00100000:1.0:1788625169.352614:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185099008 00000100:00100000:1.0:1788625169.352679:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:1.0:1788625169.352689:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:8734:x1875509185099008:12345-192.168.204.14@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788625169.352725:0:11318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788625169.352795:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:8734:x1875509185099008:12345-192.168.204.14@tcp:41:mount.lustre.0 Request processed in 107us (11964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625169.352802:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:1.0:1788625169.355971:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625169.356256:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185098880 00000100:00100000:2.0:1788625169.356265:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185098880 00000100:00100000:2.0:1788625169.356338:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00080000:1.0:1788625169.356343:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788625169.356350:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:0:x1875509185098880:12345-192.168.204.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788625169.356390:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788625169.356485:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:0:x1875509185098880:12345-192.168.204.14@tcp:41:mount.lustre.0 Request processed in 137us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625169.356506:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:0.0:1788625169.366643:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625169.366985:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185099136 00000100:00100000:3.0:1788625169.366996:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185099136 00000100:00100000:3.0:1788625169.367100:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:3.0:1788625169.367112:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:8734:x1875509185099136:12345-192.168.204.14@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788625169.367373:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:8734:x1875509185099136:12345-192.168.204.14@tcp:40:mount.lustre.0 Request processed in 262us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625169.367381:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:1.0:1788625169.370764:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625169.370811:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625169.370870:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625169.371026:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185099264 00000100:00100000:0.0:1788625169.371042:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185099264 00000100:00100000:0.0:1788625169.371094:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185099392 00000100:00100000:0.0:1788625169.371098:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185099392 00000100:00100000:0.0:1788625169.371120:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:0.0:1788625169.371129:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875509185099264:12345-192.168.204.14@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788625169.371174:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 44e8506e-584d-40a5-8ecc-bc286c2e90c7@192.168.204.14@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:0.0:1788625169.371205:0:8425:0:(genops.c:1385:class_connect()) connect: client 44e8506e-584d-40a5-8ecc-bc286c2e90c7, cookie 0x2d2e3b3f34a7a3e5 00002000:00100000:0.0:1788625169.371228:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 44e8506e-584d-40a5-8ecc-bc286c2e90c7/ffff9987438d6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788625169.371248:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788625169.373111:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788625169.373155:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9987438d5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625169.373243:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2390:x1875509185099264:12345-192.168.204.14@tcp:8:mount.lustre.0 Request processed in 2112us (2490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625169.373254:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:0.0:1788625169.373281:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:0.0:1788625169.373287:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875509185099392:12345-192.168.204.14@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788625169.373311:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 44e8506e-584d-40a5-8ecc-bc286c2e90c7@192.168.204.14@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:0.0:1788625169.373334:0:8425:0:(genops.c:1385:class_connect()) connect: client 44e8506e-584d-40a5-8ecc-bc286c2e90c7, cookie 0x2d2e3b3f34a7a3ec 00002000:00100000:0.0:1788625169.373344:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 44e8506e-584d-40a5-8ecc-bc286c2e90c7/ffff9987438d1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788625169.373358:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788625169.373390:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788625169.373403:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9987438d6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625169.373422:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2390:x1875509185099392:12345-192.168.204.14@tcp:8:mount.lustre.0 Request processed in 134us (2553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625169.373428:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:3.0:1788625169.373801:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185099520 00000100:00100000:3.0:1788625169.373810:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185099520 00000100:00100000:3.0:1788625169.373858:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 5 00000100:00100000:3.0:1788625169.373865:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:8734:x1875509185099520:12345-192.168.204.14@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788625169.373912:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:8734:x1875509185099520:12345-192.168.204.14@tcp:900:mount.lustre.0 Request processed in 47us (3101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625169.373918:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 5 00000100:00100000:1.0:1788625169.379483:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625169.379589:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185099648 00000100:00100000:2.0:1788625169.379603:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185099648 00000100:00100000:0.0:1788625169.379731:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 1 00000100:00100000:2.0:1788625169.379746:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1788625169.379761:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1788625169.379767:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:8734:x1875509185099648:12345-192.168.204.14@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788625169.379902:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788625169.380042:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:8734:x1875509185099648:12345-192.168.204.14@tcp:33:mount.lustre.0 Request processed in 295us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625169.380055:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 1 00010000:00010000:0.0:1788625169.484584:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625170.512782:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625171.213648:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206144896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625171.213778:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625171.213895:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206144896 00000100:00100000:0.0:1788625171.213906:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206144896 00000100:00100000:0.0:1788625171.213972:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788625171.213984:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206144896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625171.214034:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788625171.214335:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206144896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 351us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625171.214345:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788625171.214481:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206144896:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788625171.531896:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625171.723779:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625171.723803:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206145024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625171.723876:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625171.723992:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206145024 00000100:00100000:2.0:1788625171.724000:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206145024 00000100:00100000:2.0:1788625171.724077:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788625171.724087:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206145024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788625171.724117:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625171.724165:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206145024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625171.724171:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788625171.724215:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743a75880 x1875509206145024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625171.724233:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206145024:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788625171.724293:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625171.726473:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206145152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625171.726560:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625171.726891:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206145152 00000100:00100000:0.0:1788625171.726900:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206145152 00000100:00100000:0.0:1788625171.727005:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788625171.727015:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206145152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625171.727047:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788625171.727151:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625171.727189:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206145152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625171.727197:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788625171.727260:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743974e00 x1875509206145152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625171.727279:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206145152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625172.237350:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206145408:0@lo:400:kworker.0 00000100:00100000:1.0:1788625172.237453:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625172.237540:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206145920:0@lo:400:kworker.0 00000100:00100000:1.0:1788625172.237565:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625172.237587:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206145408 00000100:00100000:1.0:1788625172.237588:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206146432:0@lo:400:kworker.0 00000100:00100000:2.0:1788625172.237598:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206145408 00000100:00100000:1.0:1788625172.237633:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625172.237656:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206145920 00000100:00100000:1.0:1788625172.237657:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788625172.237660:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206145920 00000100:00100000:1.0:1788625172.237663:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206145280:0@lo:400:kworker.0 00000100:00100000:2.0:1788625172.237690:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206146432 00000100:00100000:1.0:1788625172.237695:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625172.237700:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206146432 00000100:00100000:2.0:1788625172.237725:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788625172.237735:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206145408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625172.237920:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206145792:0@lo:400:kworker.0 00000100:00100000:2.0:1788625172.237936:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206145408:12345-0@lo:400:kworker.0 Request processed in 201us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625172.237945:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788625172.237966:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788625172.237972:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206145920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625172.237997:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206145920:12345-0@lo:400:kworker.0 Request processed in 26us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625172.238003:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788625172.238013:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788625172.238028:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206146432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625172.238054:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206146432:12345-0@lo:400:kworker.0 Request processed in 36us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625172.238060:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788625172.238189:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625172.238316:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206146304:0@lo:400:kworker.0 00000100:00100000:2.0:1788625172.238454:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206145792 00000100:00100000:2.0:1788625172.238464:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206145792 00000100:00100000:2.0:1788625172.238567:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788625172.238577:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206145792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625172.239658:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206145792:12345-0@lo:400:kworker.0 Request processed in 1077us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625172.239671:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788625172.239856:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206145664:0@lo:400:kworker.0 00000100:00100000:0.0:1788625172.239942:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625172.239985:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206146176:0@lo:400:kworker.0 00000100:00100000:0.0:1788625172.240009:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625172.240039:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206146688:0@lo:400:kworker.0 00000100:00100000:0.0:1788625172.240061:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625172.240093:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788625172.240100:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206145536:0@lo:400:kworker.0 00000100:00100000:0.0:1788625172.240130:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625172.240148:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206146048:0@lo:400:kworker.0 00000100:00100000:0.0:1788625172.240167:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625172.240182:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206146560:0@lo:400:kworker.0 00000100:00100000:0.0:1788625172.240203:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625172.240238:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206145536 00000100:00100000:0.0:1788625172.240247:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206145536 00000100:00100000:0.0:1788625172.240286:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788625172.240295:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206145536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625172.240347:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206145536:12345-0@lo:400:kworker.0 Request processed in 53us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625172.240354:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788625172.240373:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206146176 00000100:00100000:0.0:1788625172.240376:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206146176 00000100:00100000:0.0:1788625172.240401:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206146688 00000100:00100000:0.0:1788625172.240403:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206146688 00000100:00100000:0.0:1788625172.240427:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788625172.240432:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206146176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625172.240458:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206146176:12345-0@lo:400:kworker.0 Request processed in 26us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625172.240470:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788625172.240481:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788625172.240486:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206146688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625172.240509:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206146688:12345-0@lo:400:kworker.0 Request processed in 23us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625172.240545:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788625172.240588:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206145664 00000100:00100000:0.0:1788625172.240594:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206145664 00000100:00100000:0.0:1788625172.240613:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206146048 00000100:00100000:0.0:1788625172.240616:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206146048 00000100:00100000:0.0:1788625172.240627:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206146560 00000100:00100000:0.0:1788625172.240630:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206146560 00000100:00100000:0.0:1788625172.240645:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788625172.240653:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206145664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625172.240673:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625172.240694:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206145664:12345-0@lo:400:kworker.0 Request processed in 40us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625172.240702:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788625172.240716:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788625172.240725:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206146048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625172.240754:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206146816:0@lo:400:kworker.0 00000100:00100000:0.0:1788625172.240764:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206146048:12345-0@lo:400:kworker.0 Request processed in 37us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625172.240771:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788625172.240781:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788625172.240788:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206146560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625172.240826:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625172.240832:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206146560:12345-0@lo:400:kworker.0 Request processed in 44us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625172.240850:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788625172.240887:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206145408:0@lo:400:kworker.0 00000100:00100000:0.0:1788625172.240914:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206145536:0@lo:400:kworker.0 00000100:00100000:1.0:1788625172.240925:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206145920:0@lo:400:kworker.0 00010000:00080000:0.0:1788625172.240940:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844934380 x1875509206146048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625172.240953:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206146432:0@lo:400:kworker.0 00000100:00100000:0.0:1788625172.240962:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206146048:0@lo:400:kworker.0 00010000:00080000:0.0:1788625172.240981:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844934e00 x1875509206146560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625172.240994:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206146560:0@lo:400:kworker.0 00000100:00100000:1.0:1788625172.241010:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206145792:0@lo:400:kworker.0 00000100:00100000:0.0:1788625172.241015:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206145664:0@lo:400:kworker.0 00010000:00080000:0.0:1788625172.241041:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844937800 x1875509206146176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625172.241051:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206146176:0@lo:400:kworker.0 00010000:00080000:0.0:1788625172.241068:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99885eec4e00 x1875509206146688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625172.241078:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206146688:0@lo:400:kworker.0 00000100:00080000:1.0:1788625172.241094:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625172.241104:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625172.241111:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625172.241138:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206145280 00000100:00100000:1.0:1788625172.241145:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206145280 00000100:00100000:1.0:1788625172.241202:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788625172.241210:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206145280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625172.241266:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206145280:12345-0@lo:400:kworker.0 Request processed in 56us (3570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625172.241273:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788625172.241305:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206146304 00000100:00100000:1.0:1788625172.241309:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206146304 00000100:00100000:1.0:1788625172.241333:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206146816 00000100:00100000:1.0:1788625172.241336:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206146816 00000100:00100000:1.0:1788625172.242536:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788625172.242556:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206146304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625172.242635:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206146304:12345-0@lo:400:kworker.0 Request processed in 87us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625172.245106:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788625172.245140:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206146816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625172.245247:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206146816:12345-0@lo:400:kworker.0 Request processed in 125us (4423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625172.245275:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788625172.245636:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206145280:0@lo:400:kworker.0 00010000:00080000:0.0:1788625172.245666:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844935880 x1875509206146304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625172.245679:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206146304:0@lo:400:kworker.0 00010000:00080000:0.0:1788625172.245693:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99885eec5180 x1875509206146816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625172.246232:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206146816:0@lo:400:kworker.0 00000100:00100000:1.0:1788625172.246666:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788625172.246710:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788625172.555745:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625172.747900:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625172.747976:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206146944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625172.748069:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625172.748264:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206147072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625172.748299:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625172.748336:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206147200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625172.748364:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206147072 00000100:00100000:1.0:1788625172.748373:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206147072 00000100:00100000:3.0:1788625172.748410:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625172.748452:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206146944 00000100:00100000:2.0:1788625172.748457:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206146944 00000100:00100000:2.0:1788625172.748691:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788625172.748704:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206146944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788625172.748738:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788625172.748913:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206147200 00000100:00100000:1.0:1788625172.748932:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206147200 00000100:00100000:1.0:1788625172.748956:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788625172.748962:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206147072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788625172.748981:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625172.749062:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206147072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625172.749069:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788625172.749085:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788625172.749092:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206147200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788625172.749101:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625172.749132:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206147200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625172.749138:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788625172.749174:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844935880 x1875509206147072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625172.749194:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206147072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625172.749228:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206146944:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1788625172.749279:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743975500 x1875509206147200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625172.749292:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206147200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625172.749411:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206146944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 709us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625172.749418:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00010000:1.0:1788625173.583909:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788625174.059997:0:12182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1788625174.525107:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625174.525211:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625174.525243:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625174.525279:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625174.525322:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625174.525339:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625174.525362:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625174.525392:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185100032 00000100:00100000:3.0:1788625174.525399:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185100288 00000100:00100000:3.0:1788625174.525409:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185100288 00000100:00100000:1.0:1788625174.525410:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185100032 00000100:00100000:3.0:1788625174.525474:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185100160 00000100:00100000:0.0:1788625174.525474:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185099904 00000100:00100000:3.0:1788625174.525478:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185100160 00000100:00100000:0.0:1788625174.525482:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185099904 00000100:00100000:3.0:1788625174.525505:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 144 00000100:00100000:0.0:1788625174.525570:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 145 00000100:00100000:0.0:1788625174.525579:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2393:x1875509185100160:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625174.525658:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2393:x1875509185100160:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 80us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625174.525665:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 145 00000100:00100000:0.0:1788625174.525686:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 146 00000100:00100000:0.0:1788625174.525691:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185099904:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625174.525715:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185099904:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 24us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625174.525720:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 146 00000100:00100000:0.0:1788625174.525739:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185100544 00000100:00100000:0.0:1788625174.525742:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185100544 00000100:00100000:0.0:1788625174.525780:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185100416 00000100:00100000:0.0:1788625174.525784:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185100416 00000100:00100000:0.0:1788625174.525805:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00100000:0.0:1788625174.525811:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2393:x1875509185100544:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625174.525841:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2393:x1875509185100544:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625174.525848:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00100000:0.0:1788625174.525858:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 58 00000100:00100000:0.0:1788625174.525872:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2393:x1875509185100416:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625174.525898:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2393:x1875509185100416:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 28us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625174.525904:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 58 00000100:00080000:0.0:1788625174.525943:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625174.525947:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625174.525950:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788625174.525952:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788625174.527721:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 147 00000100:00100000:1.0:1788625174.527734:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185100032:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625174.527856:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185099776 00000100:00100000:2.0:1788625174.527863:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185099776 00000100:00100000:2.0:1788625174.527896:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 306 00000100:00100000:2.0:1788625174.527903:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185099776:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625174.527964:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185099776:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 62us (2867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625174.527983:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 306 00000100:00100000:1.0:1788625174.528336:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185100032:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 605us (3125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625174.528344:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 147 00000100:00100000:3.0:1788625174.541277:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2393:x1875509185100288:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625174.541397:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2393:x1875509185100288:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 15880us (16150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625174.541409:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 144 00010000:00010000:1.0:1788625174.603775:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788625174.801372:0:9503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 44e8506e-584d-40a5-8ecc-bc286c2e90c7 00000001:00100000:3.0:1788625174.802221:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 44e8506e-584d-40a5-8ecc-bc286c2e90c7 00000001:00100000:3.0:1788625174.802828:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 44e8506e-584d-40a5-8ecc-bc286c2e90c7 00000001:00100000:1.0:1788625174.804190:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 44e8506e-584d-40a5-8ecc-bc286c2e90c7 00010000:00010000:0.0:1788625175.627727:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625176.331977:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625176.332006:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206147328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788625176.332460:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625176.332805:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206147328 00000100:00100000:0.0:1788625176.332814:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206147328 00000100:00100000:0.0:1788625176.332947:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788625176.332958:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206147328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625176.332992:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788625176.333128:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206147328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625176.333142:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788625176.333152:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206147328:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788625176.652662:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625176.847800:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206147456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625176.847871:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625176.848015:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625176.848025:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206147584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625176.848055:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625176.848088:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206147456 00000100:00100000:0.0:1788625176.848096:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206147456 00000100:00100000:0.0:1788625176.848152:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206147584 00000100:00100000:0.0:1788625176.848155:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206147584 00000100:00100000:0.0:1788625176.848175:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788625176.848184:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206147456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625176.848221:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625176.848268:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206147456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625176.848282:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788625176.848300:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788625176.848306:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206147584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625176.848316:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625176.848342:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206147584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625176.848348:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788625176.848363:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788625176.848398:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c2b100 x1875509206147584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625176.848418:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206147584:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788625176.848449:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743a74e00 x1875509206147456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625176.848461:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206147456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625177.358878:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206147712:0@lo:400:kworker.0 00000100:00100000:2.0:1788625177.358963:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625177.359111:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206147712 00000100:00100000:3.0:1788625177.359120:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206147712 00000100:00100000:3.0:1788625177.359179:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788625177.359189:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206147712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625177.359600:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206147968:0@lo:400:kworker.0 00000100:00100000:1.0:1788625177.359636:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625177.359660:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206148480:0@lo:400:kworker.0 00000100:00100000:1.0:1788625177.359684:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625177.359702:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206148992:0@lo:400:kworker.0 00000100:00100000:1.0:1788625177.359722:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625177.359742:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788625177.359749:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206147840:0@lo:400:kworker.0 00000100:00100000:1.0:1788625177.359768:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625177.362195:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206147712:12345-0@lo:400:kworker.0 Request processed in 2995us (3220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625177.362212:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788625177.362337:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206148096:0@lo:400:kworker.0 00000100:00100000:3.0:1788625177.362397:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625177.362445:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206148608:0@lo:400:kworker.0 00000100:00100000:3.0:1788625177.362471:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625177.362941:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206148352:0@lo:400:kworker.0 00000100:00100000:3.0:1788625177.362944:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206149120:0@lo:400:kworker.0 00000100:00100000:3.0:1788625177.362983:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625177.362992:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625177.363015:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788625177.363024:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206148864:0@lo:400:kworker.0 00000100:00100000:3.0:1788625177.363027:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206148224:0@lo:400:kworker.0 00000100:00100000:3.0:1788625177.363060:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625177.363072:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625177.363091:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206148736:0@lo:400:kworker.0 00000100:00100000:1.0:1788625177.363113:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206148480 00000100:00100000:3.0:1788625177.363119:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625177.363124:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206148480 00000100:00100000:3.0:1788625177.363144:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206149248:0@lo:400:kworker.0 00000100:00100000:3.0:1788625177.363171:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625177.363177:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206148992 00000100:00100000:1.0:1788625177.363182:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206148992 00000100:00100000:1.0:1788625177.363203:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206147840 00000100:00100000:1.0:1788625177.363206:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206147840 00000100:00100000:1.0:1788625177.363222:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206148096 00000100:00100000:1.0:1788625177.363226:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206148096 00000100:00100000:3.0:1788625177.363228:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206148608 00000100:00100000:3.0:1788625177.363235:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206148608 00000100:00100000:1.0:1788625177.363239:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206148352 00000100:00100000:1.0:1788625177.363244:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206148352 00000100:00100000:1.0:1788625177.363257:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206148864 00000100:00100000:1.0:1788625177.363259:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206148864 00000100:00100000:1.0:1788625177.363274:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788625177.363281:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206148480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625177.363326:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206149120 00000100:00100000:3.0:1788625177.363331:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206149120 00000100:00100000:1.0:1788625177.363340:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206148480:12345-0@lo:400:kworker.0 Request processed in 58us (3655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625177.363347:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206148736 00000100:00100000:1.0:1788625177.363351:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788625177.363352:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206148736 00000100:00100000:3.0:1788625177.363373:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206149248 00000100:00100000:1.0:1788625177.363376:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788625177.363377:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206149248 00000100:00100000:1.0:1788625177.363389:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206148992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625177.363399:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788625177.363407:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206148608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625177.363428:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206148992:12345-0@lo:400:kworker.0 Request processed in 42us (3704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625177.363436:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788625177.363448:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788625177.363454:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206147840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625177.364896:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206147712:0@lo:400:kworker.0 00000100:00100000:2.0:1788625177.364971:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788625177.364982:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206149120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625177.365337:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206147840:12345-0@lo:400:kworker.0 Request processed in 1881us (5565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625177.365349:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788625177.365351:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206148608:12345-0@lo:400:kworker.0 Request processed in 1941us (2874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625177.365365:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788625177.365383:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788625177.365394:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788625177.365395:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206148096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625177.365409:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206148736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625177.365440:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206148096:12345-0@lo:400:kworker.0 Request processed in 49us (3042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625177.365446:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788625177.365458:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788625177.365465:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206148352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625177.365494:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206148352:12345-0@lo:400:kworker.0 Request processed in 30us (2504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625177.365500:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788625177.365511:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788625177.365533:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206148864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625177.365562:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206148864:12345-0@lo:400:kworker.0 Request processed in 46us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625177.365568:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1788625177.365594:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625177.365600:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625177.365602:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788625177.365631:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206147840:0@lo:400:kworker.0 00000100:00100000:1.0:1788625177.365642:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206148352:0@lo:400:kworker.0 00000100:00100000:1.0:1788625177.365650:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206148864:0@lo:400:kworker.0 00010000:00080000:1.0:1788625177.365664:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887cb10700 x1875509206148480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625177.365673:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206148480:0@lo:400:kworker.0 00010000:00080000:1.0:1788625177.365695:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887cb13480 x1875509206148992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625177.365703:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206148992:0@lo:400:kworker.0 00000100:00100000:3.0:1788625177.365988:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206148736:12345-0@lo:400:kworker.0 Request processed in 582us (2868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625177.365997:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788625177.366017:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788625177.366026:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206149248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625177.366065:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206149248:12345-0@lo:400:kworker.0 Request processed in 43us (2895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625177.366074:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788625177.366101:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206147968 00000100:00100000:3.0:1788625177.366108:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206147968 00000100:00100000:3.0:1788625177.366151:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206148224 00000100:00100000:3.0:1788625177.366155:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206148224 00000100:00100000:3.0:1788625177.366170:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788625177.366177:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206147968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625177.366249:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206147968:12345-0@lo:400:kworker.0 Request processed in 73us (6612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625177.366257:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788625177.366270:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788625177.366276:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206148224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625177.366308:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206148224:12345-0@lo:400:kworker.0 Request processed in 32us (3248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625177.366316:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788625177.366356:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206148224:0@lo:400:kworker.0 00010000:00080000:3.0:1788625177.366372:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887cb13b80 x1875509206148736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625177.366383:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206148736:0@lo:400:kworker.0 00010000:00080000:3.0:1788625177.366394:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887cb13100 x1875509206149248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625177.366403:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206149248:0@lo:400:kworker.0 00000100:00100000:3.0:1788625177.366415:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206148096:0@lo:400:kworker.0 00010000:00080000:3.0:1788625177.366426:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887cb11880 x1875509206148608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625177.366446:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206148608:0@lo:400:kworker.0 00000100:00100000:2.0:1788625177.369387:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206149120:12345-0@lo:400:kworker.0 Request processed in 4070us (6065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625177.369406:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788625177.369883:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206147968:0@lo:400:kworker.0 00010000:00080000:3.0:1788625177.370586:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887cb11180 x1875509206149120/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625177.370605:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206149120:0@lo:400:kworker.0 00010000:00010000:1.0:1788625177.677034:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625177.868734:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625177.868760:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206149376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625177.869410:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625177.869764:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206149504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625177.869903:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625177.869953:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206149504 00000100:00100000:3.0:1788625177.869960:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206149504 00000100:00100000:3.0:1788625177.870015:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788625177.870025:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206149504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788625177.870059:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788625177.870121:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206149504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625177.870130:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788625177.870156:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206149632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625177.870188:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625177.870236:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206149376 00000100:00100000:1.0:1788625177.870237:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206149504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625177.870241:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206149376 00000100:00100000:0.0:1788625177.870280:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206149632 00000100:00100000:0.0:1788625177.870284:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206149632 00000100:00100000:0.0:1788625177.870298:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788625177.870305:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206149376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625177.870330:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625177.870380:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206149376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625177.870387:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788625177.870400:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788625177.870427:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206149632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788625177.870439:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625177.870477:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206149632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625177.870484:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1788625177.870511:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743974e00 x1875509206149632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625177.870553:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206149632:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788625177.871468:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887cb13480 x1875509206149376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625177.871486:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206149376:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788625178.700714:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625179.653072:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625179.653107:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625179.653131:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625179.653154:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625179.653181:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625179.653203:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625179.653227:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625179.653259:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185100672 00000100:00100000:2.0:1788625179.653269:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185100672 00000100:00100000:2.0:1788625179.653322:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 308 00000100:00100000:2.0:1788625179.653333:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2394:x1875509185100672:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625179.653422:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2394:x1875509185100672:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 90us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625179.653430:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 308 00000100:00100000:2.0:1788625179.653466:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185100928 00000100:00100000:2.0:1788625179.653470:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185100928 00000100:00100000:2.0:1788625179.653507:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185101184 00000100:00100000:2.0:1788625179.653510:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185101184 00000100:00100000:2.0:1788625179.653550:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185100800 00000100:00100000:2.0:1788625179.653554:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185100800 00000100:00100000:2.0:1788625179.653563:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185101056 00000100:00100000:2.0:1788625179.653580:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185101056 00000100:00100000:2.0:1788625179.653600:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 154 00000100:00100000:2.0:1788625179.653606:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185100928:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625179.653637:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185100928:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 31us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625179.653643:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 154 00000100:00100000:2.0:1788625179.653656:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 155 00000100:00100000:2.0:1788625179.653662:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185101184:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625179.653685:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185101184:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 23us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625179.653691:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 155 00000100:00100000:2.0:1788625179.653703:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 156 00000100:00100000:2.0:1788625179.653708:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185100800:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625179.653732:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185100800:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 24us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625179.653738:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 156 00000100:00100000:2.0:1788625179.653749:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 157 00000100:00100000:2.0:1788625179.653756:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185101056:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625179.653777:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185101056:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 23us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625179.653782:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 157 00000100:00080000:2.0:1788625179.653921:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788625179.653925:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625179.660006:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185101440 00000100:00100000:3.0:1788625179.660026:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185101440 00000100:00100000:3.0:1788625179.660309:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185101312 00000100:00100000:3.0:1788625179.660314:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185101312 00000100:00100000:3.0:1788625179.660362:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 63 00000100:00100000:3.0:1788625179.660374:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185101440:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625179.660464:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185101440:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 93us (7308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625179.660472:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 63 00000100:00100000:3.0:1788625179.660493:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:3.0:1788625179.660500:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185101312:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625179.660548:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185101312:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 49us (7320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625179.660555:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00080000:2.0:1788625179.662868:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788625179.662901:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788625179.724122:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788625180.031780:0:12498:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625180.033329:0:12498:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788625180.750949:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625181.460081:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625181.460110:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206149760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625181.460209:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625181.460326:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206149760 00000100:00100000:2.0:1788625181.460334:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206149760 00000100:00100000:2.0:1788625181.460385:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788625181.460395:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206149760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788625181.460436:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788625181.460501:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206149760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625181.460508:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788625181.460588:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206149760:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788625181.776491:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625181.967446:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206149888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625181.967577:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625181.967650:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206149888 00000100:00100000:3.0:1788625181.967657:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206149888 00000100:00100000:3.0:1788625181.967711:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788625181.967721:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206149888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788625181.967751:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625181.967794:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206149888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625181.967801:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788625181.967832:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788625181.967865:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743a74700 x1875509206149888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625181.967884:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206149888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625181.970194:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206150016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625181.970267:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625181.970589:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206150016 00000100:00100000:1.0:1788625181.970597:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206150016 00000100:00100000:1.0:1788625181.970657:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788625181.970666:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206150016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625181.970699:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625181.970746:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206150016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625181.970754:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788625181.970806:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788625181.970849:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887cb11c00 x1875509206150016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625181.970869:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206150016:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1788625182.012102:0:12595:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625182.012796:0:12595:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788625182.475745:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206150144:0@lo:400:kworker.0 00000100:00100000:1.0:1788625182.475841:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206150400:0@lo:400:kworker.0 00000100:00100000:3.0:1788625182.475918:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206150272:0@lo:400:kworker.0 00000100:00100000:1.0:1788625182.476335:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625182.476399:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206150912:0@lo:400:kworker.0 00000100:00100000:1.0:1788625182.476446:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625182.476568:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206151424:0@lo:400:kworker.0 00000100:00100000:1.0:1788625182.476594:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625182.476627:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788625182.476633:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206150528:0@lo:400:kworker.0 00000100:00100000:1.0:1788625182.476662:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625182.476685:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206151040:0@lo:400:kworker.0 00000100:00100000:1.0:1788625182.476707:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625182.476743:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206150400 00000100:00100000:1.0:1788625182.476750:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206150400 00000100:00100000:1.0:1788625182.476794:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788625182.476802:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206150400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625182.478139:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625182.478176:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625182.478219:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206150656:0@lo:400:kworker.0 00000100:00100000:2.0:1788625182.478272:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625182.478293:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206151168:0@lo:400:kworker.0 00000100:00100000:2.0:1788625182.478316:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625182.478357:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206150784:0@lo:400:kworker.0 00000100:00100000:3.0:1788625182.478402:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625182.478420:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206151296:0@lo:400:kworker.0 00000100:00100000:3.0:1788625182.478444:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625182.478538:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206150144 00000100:00100000:3.0:1788625182.478547:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206150144 00000100:00100000:3.0:1788625182.478577:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788625182.478582:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3637:x1875509206150144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625182.478647:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3637:x1875509206150144:12345-0@lo:400:kworker.0 Request processed in 64us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625182.478655:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788625182.478688:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206151424 00000100:00100000:3.0:1788625182.478693:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206150912 00000100:00100000:3.0:1788625182.478697:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206150912 00000100:00100000:3.0:1788625182.478724:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206150528 00000100:00100000:3.0:1788625182.478727:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206150528 00000100:00100000:3.0:1788625182.478738:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206151040 00000100:00100000:3.0:1788625182.478741:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206151040 00000100:00100000:3.0:1788625182.478752:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206150272 00000100:00100000:3.0:1788625182.478755:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206150272 00000100:00100000:2.0:1788625182.478760:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206151424 00000100:00100000:3.0:1788625182.478764:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206151168 00000100:00100000:3.0:1788625182.478766:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206151168 00000100:00100000:3.0:1788625182.478776:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206150784 00000100:00100000:3.0:1788625182.478778:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206150784 00000100:00100000:2.0:1788625182.478786:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206151296 00000100:00100000:2.0:1788625182.478788:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206151296 00000100:00100000:3.0:1788625182.478790:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788625182.478795:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206150912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625182.478804:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788625182.478809:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206151424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625182.478867:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206151424:12345-0@lo:400:kworker.0 Request processed in 57us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625182.478874:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788625182.478887:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788625182.478943:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206151296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625182.478987:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206151296:12345-0@lo:400:kworker.0 Request processed in 87us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625182.478994:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788625182.479003:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206150400:12345-0@lo:400:kworker.0 Request processed in 2199us (2666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625182.479014:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788625182.479031:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206150656 00000100:00100000:1.0:1788625182.479035:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206150656 00000100:00100000:1.0:1788625182.479054:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788625182.479061:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206150656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625182.479066:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206150912:12345-0@lo:400:kworker.0 Request processed in 269us (2617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625182.479079:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788625182.479095:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788625182.479103:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206150528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625182.479106:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206150656:12345-0@lo:400:kworker.0 Request processed in 45us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625182.479120:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788625182.479151:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206150528:12345-0@lo:400:kworker.0 Request processed in 50us (2488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625182.479158:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788625182.479171:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788625182.479177:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206151040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625182.479204:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206151040:12345-0@lo:400:kworker.0 Request processed in 28us (2496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625182.479210:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788625182.479221:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788625182.479226:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206150272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625182.479252:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206150272:12345-0@lo:400:kworker.0 Request processed in 26us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625182.479258:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788625182.479269:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788625182.479275:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206151168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625182.479301:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206151168:12345-0@lo:400:kworker.0 Request processed in 27us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625182.479307:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788625182.479318:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788625182.479324:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206150784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625182.479349:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206150784:12345-0@lo:400:kworker.0 Request processed in 26us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625182.479355:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1788625182.479378:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625182.479383:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625182.479391:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625182.479443:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206150272:0@lo:400:kworker.0 00000100:00100000:3.0:1788625182.479454:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206150784:0@lo:400:kworker.0 00010000:00080000:3.0:1788625182.479466:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742d27480 x1875509206151296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625182.479476:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206151296:0@lo:400:kworker.0 00010000:00080000:3.0:1788625182.479512:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742d25500 x1875509206151168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625182.479542:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206151168:0@lo:400:kworker.0 00000100:00100000:3.0:1788625182.479558:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206150144:0@lo:400:kworker.0 00000100:00100000:3.0:1788625182.479569:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206150656:0@lo:400:kworker.0 00000100:00100000:3.0:1788625182.479735:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206150528:0@lo:400:kworker.0 00000100:00100000:3.0:1788625182.479746:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206151040:0@lo:400:kworker.0 00000100:00100000:3.0:1788625182.479756:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206150400:0@lo:400:kworker.0 00010000:00080000:3.0:1788625182.479767:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742d26300 x1875509206150912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625182.479776:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206150912:0@lo:400:kworker.0 00010000:00080000:3.0:1788625182.479787:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742d25f80 x1875509206151424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625182.479793:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206151424:0@lo:400:kworker.0 00010000:00010000:1.0:1788625182.795831:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625182.988244:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625182.988277:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206151552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625182.988346:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625182.988410:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625182.988419:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206151680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625182.988449:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625182.988476:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206151552 00000100:00100000:3.0:1788625182.988483:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206151552 00000100:00100000:3.0:1788625182.988580:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788625182.988589:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cdac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206151552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788625182.988622:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625182.988681:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cdac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206151552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625182.988689:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788625182.988889:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206151680 00000100:00100000:3.0:1788625182.988894:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206151680 00000100:00100000:3.0:1788625182.988918:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788625182.988925:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206151680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788625182.988948:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788625182.988999:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206151680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625182.989006:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788625182.989047:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206151680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625182.989090:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206151808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625182.989115:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625182.989142:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206151808 00000100:00100000:3.0:1788625182.989145:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206151808 00000100:00100000:3.0:1788625182.989176:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788625182.989182:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206151808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788625182.989193:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625182.989222:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206151808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625182.989228:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1788625182.989250:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742e42300 x1875509206151808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625182.989265:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206151808:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788625182.989288:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743836680 x1875509206151552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625182.989301:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206151552:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788625183.821824:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788625183.889471:0:12692:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788625183.890034:0:12692:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788625184.765201:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625184.765252:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625184.765286:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625184.765315:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625184.765339:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625184.765380:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185101568 00000100:00100000:3.0:1788625184.765392:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185101568 00000100:00100000:3.0:1788625184.765487:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 310 00000100:00100000:3.0:1788625184.765497:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2391:x1875509185101568:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625184.765647:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2391:x1875509185101568:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 151us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625184.765656:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 310 00000100:00100000:0.0:1788625184.776405:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625184.776624:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185101824 00000100:00100000:3.0:1788625184.776634:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185101824 00000100:00080000:3.0:1788625184.776681:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625184.776726:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185102080 00000100:00100000:3.0:1788625184.776730:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185102080 00000100:00100000:3.0:1788625184.776753:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185101696 00000100:00100000:2.0:1788625184.776882:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 164 00000100:00100000:2.0:1788625184.776895:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185101824:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625184.776979:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185101824:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 87us (11725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625184.776987:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 164 00000100:00100000:2.0:1788625184.777009:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 165 00000100:00100000:2.0:1788625184.777016:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185102080:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625184.777040:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185102080:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 25us (11755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625184.777047:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 165 00000100:00100000:3.0:1788625184.777155:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185101696 00000100:00100000:3.0:1788625184.777210:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 166 00000100:00100000:3.0:1788625184.777218:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2391:x1875509185101696:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625184.777257:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2391:x1875509185101696:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 40us (11916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625184.777263:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 166 00000100:00080000:3.0:1788625184.777305:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625184.777309:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625184.787583:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625184.787617:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185102336 00000100:00100000:0.0:1788625184.787626:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185102336 00000100:00100000:0.0:1788625184.787683:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185102208 00000100:00100000:0.0:1788625184.787686:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185102208 00000100:00100000:0.0:1788625184.787710:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 67 00000100:00100000:0.0:1788625184.787721:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185102336:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625184.787820:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185102336:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 101us (22503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625184.787829:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 67 00000100:00100000:0.0:1788625184.787846:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 68 00000100:00100000:0.0:1788625184.787853:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185102208:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625184.787876:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185102208:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 24us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625184.787894:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 68 00000100:00080000:0.0:1788625184.787918:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625184.787923:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625184.789176:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185101952 00000100:00100000:3.0:1788625184.789188:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185101952 00000100:00100000:3.0:1788625184.789252:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 167 00000100:00100000:3.0:1788625184.789260:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185101952:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625184.789324:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185101952:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 58us (12924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625184.789333:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 167 00000100:00080000:0.0:1788625184.789874:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788625184.847706:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625185.868980:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788625185.982758:0:12790:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625185.982998:0:12790:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788625186.575368:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206151936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625186.575462:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625186.575571:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206151936 00000100:00100000:2.0:1788625186.575582:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206151936 00000100:00100000:2.0:1788625186.575635:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788625186.575645:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206151936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788625186.575685:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788625186.575744:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206151936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625186.575778:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788625186.576092:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206151936:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788625186.891799:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625187.086595:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625187.086633:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206152064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625187.086759:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625187.087011:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206152064 00000100:00100000:1.0:1788625187.087026:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206152064 00000100:00100000:1.0:1788625187.087096:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788625187.087108:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206152064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625187.087143:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625187.087247:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206152064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625187.087254:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788625187.087304:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743834700 x1875509206152064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625187.087324:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206152064:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788625187.088149:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625187.089150:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625187.089182:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206152192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625187.089283:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625187.089352:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206152192 00000100:00100000:1.0:1788625187.089365:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206152192 00000100:00080000:3.0:1788625187.089428:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625187.089451:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788625187.089463:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206152192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788625187.089486:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625187.089599:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206152192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625187.089608:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1788625187.089701:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743a77480 x1875509206152192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625187.089740:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206152192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625187.599170:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206152320:0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.599171:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206152448:0@lo:400:kworker.0 00000100:00100000:3.0:1788625187.599246:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206152704:0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.601109:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625187.602088:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625187.603603:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625187.603659:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206153216:0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.603660:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206152960:0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.603991:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625187.604016:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206152576:0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.604035:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206153472:0@lo:400:kworker.0 00000100:00100000:3.0:1788625187.604063:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625187.604076:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625187.604102:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206153088:0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.604127:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206153472 00000100:00100000:3.0:1788625187.604134:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625187.604139:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206153472 00000100:00100000:3.0:1788625187.604156:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206153600:0@lo:400:kworker.0 00000100:00100000:3.0:1788625187.604183:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625187.604216:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206153600 00000100:00100000:1.0:1788625187.604221:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206153600 00000100:00100000:1.0:1788625187.604250:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788625187.604260:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206153472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.604413:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206153472:12345-0@lo:400:kworker.0 Request processed in 153us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625187.604421:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788625187.604443:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788625187.604450:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206153600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.604481:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206153600:12345-0@lo:400:kworker.0 Request processed in 32us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625187.604488:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788625187.604562:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743832300 x1875509206153472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625187.604579:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206153472:0@lo:400:kworker.0 00000100:00080000:1.0:1788625187.604646:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625187.604660:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206152448 00000100:00100000:1.0:1788625187.604664:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206152448 00000100:00100000:1.0:1788625187.604693:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206152704 00000100:00100000:1.0:1788625187.604696:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206152704 00000100:00100000:1.0:1788625187.604720:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206152960 00000100:00100000:1.0:1788625187.604736:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206152960 00000100:00100000:1.0:1788625187.604758:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206153088 00000100:00100000:1.0:1788625187.604761:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206153088 00000100:00100000:1.0:1788625187.604775:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788625187.604781:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206152448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.604821:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206152448:12345-0@lo:400:kworker.0 Request processed in 40us (3721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625187.604827:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788625187.604838:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788625187.604844:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206152704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.604875:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206152704:12345-0@lo:400:kworker.0 Request processed in 31us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625187.604881:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788625187.604971:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788625187.604977:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206152960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.605008:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206152960:12345-0@lo:400:kworker.0 Request processed in 31us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625187.605013:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788625187.605024:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788625187.605029:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206153088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.605055:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206153088:12345-0@lo:400:kworker.0 Request processed in 26us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625187.605061:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788625187.605081:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206152576 00000100:00100000:1.0:1788625187.605085:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206152576 00000100:00100000:1.0:1788625187.605122:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788625187.605129:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206152576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.605173:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206152576:12345-0@lo:400:kworker.0 Request processed in 45us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625187.605179:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788625187.605204:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625187.605207:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625187.605241:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206152960:0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.605254:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206152448:0@lo:400:kworker.0 00000100:00100000:2.0:1788625187.605583:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206152832:0@lo:400:kworker.0 00000100:00100000:2.0:1788625187.605626:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625187.605647:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206152832 00000100:00100000:2.0:1788625187.605651:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206152832 00000100:00100000:2.0:1788625187.605676:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788625187.605682:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206152832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625187.605726:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206152832:12345-0@lo:400:kworker.0 Request processed in 44us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625187.605732:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788625187.605765:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206152832:0@lo:400:kworker.0 00000100:00100000:2.0:1788625187.605773:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206153344:0@lo:400:kworker.0 00000100:00100000:2.0:1788625187.605800:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625187.605844:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625187.605879:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206152704:0@lo:400:kworker.0 00000100:00100000:2.0:1788625187.606224:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206152576:0@lo:400:kworker.0 00010000:00080000:2.0:1788625187.606241:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743974380 x1875509206153088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625187.606252:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206153088:0@lo:400:kworker.0 00010000:00080000:2.0:1788625187.606266:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743830000 x1875509206153600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625187.606284:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206153600:0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.606514:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206153344 00000100:00100000:1.0:1788625187.606536:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206153344 00000100:00100000:1.0:1788625187.606582:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206153216 00000100:00100000:1.0:1788625187.606586:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206153216 00000100:00100000:1.0:1788625187.606606:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788625187.606613:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206153344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.606673:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206153344:12345-0@lo:400:kworker.0 Request processed in 60us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625187.606680:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788625187.606696:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788625187.606704:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206153216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625187.606750:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206153216:12345-0@lo:400:kworker.0 Request processed in 48us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625187.606757:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788625187.607008:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206152320 00000100:00100000:2.0:1788625187.607014:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206152320 00000100:00100000:2.0:1788625187.607049:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788625187.607056:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206152320:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788625187.607067:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788625187.607074:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788625187.607103:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206152320:12345-0@lo:400:kworker.0 Request processed in 46us (5018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625187.607111:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788625187.607160:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206153216:0@lo:400:kworker.0 00010000:00080000:2.0:1788625187.607174:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743974e00 x1875509206153344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625187.607186:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206153344:0@lo:400:kworker.0 00000100:00100000:2.0:1788625187.607198:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206152320:0@lo:400:kworker.0 00010000:00010000:1.0:1788625187.918836:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625188.108987:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625188.109021:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206153728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625188.109129:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625188.109743:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206153728 00000100:00100000:1.0:1788625188.109755:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206153728 00000100:00100000:0.0:1788625188.109769:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625188.109784:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206153856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625188.109830:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788625188.109846:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625188.109847:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206153728:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625188.109885:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625188.109896:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206153984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625188.109933:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788625188.109942:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625188.109963:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206153856 00000100:00100000:0.0:1788625188.109967:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206153856 00000100:00100000:0.0:1788625188.110004:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788625188.110009:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206153728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 164us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625188.110017:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206153856:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625188.110023:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00002000:00000024:0.0:1788625188.110033:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625188.110074:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206153856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625188.110081:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788625188.110102:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206153984 00000100:00100000:0.0:1788625188.110106:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206153984 00000100:00100000:0.0:1788625188.110134:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788625188.110140:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206153984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788625188.110178:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788625188.110221:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206153984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625188.110228:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1788625188.110269:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743834000 x1875509206153856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625188.110291:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206153856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625188.110494:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206153984:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1788625188.110675:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742d27800 x1875509206153728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625188.110689:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206153728:0@lo:13:osp-pre-1-1.0 00000020:00000004:1.0:1788625188.152957:0:12887:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788625188.153242:0:12887:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788625188.940236:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625189.885182:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625189.885232:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625189.885258:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625189.885275:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625189.885293:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625189.885317:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625189.885410:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625189.885445:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185102464 00000100:00100000:3.0:1788625189.885456:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185102464 00000100:00100000:3.0:1788625189.886717:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 312 00000100:00100000:3.0:1788625189.886736:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185102464:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625189.886840:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185102464:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 110us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625189.886848:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 312 00000100:00100000:3.0:1788625189.886902:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185102720 00000100:00100000:3.0:1788625189.886909:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185102720 00000100:00100000:3.0:1788625189.886962:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185102976 00000100:00100000:3.0:1788625189.886966:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185102976 00000100:00100000:3.0:1788625189.886979:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185102592 00000100:00100000:3.0:1788625189.886981:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185102592 00000100:00100000:3.0:1788625189.886994:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185102848 00000100:00100000:3.0:1788625189.886996:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185102848 00000100:00100000:3.0:1788625189.887011:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 174 00000100:00100000:3.0:1788625189.887017:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185102720:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625189.887055:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185102720:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 38us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625189.887063:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 174 00000100:00100000:3.0:1788625189.887076:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 175 00000100:00100000:3.0:1788625189.887082:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185102976:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625189.887108:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185102976:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 26us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625189.887115:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 175 00000100:00100000:3.0:1788625189.887126:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 176 00000100:00100000:3.0:1788625189.887132:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185102592:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625189.887158:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185102592:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 25us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625189.887179:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 176 00000100:00100000:3.0:1788625189.887192:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 177 00000100:00100000:3.0:1788625189.887198:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185102848:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625189.887224:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185102848:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 26us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625189.887230:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 177 00000100:00100000:3.0:1788625189.887261:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185103104 00000100:00100000:3.0:1788625189.887266:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185103104 00000100:00100000:3.0:1788625189.887297:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185103232 00000100:00100000:3.0:1788625189.887301:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185103232 00000100:00100000:3.0:1788625189.887325:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 22 00000100:00100000:3.0:1788625189.887332:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2390:x1875509185103104:12345-192.168.204.14@tcp:9:kworker.0 00000020:00000080:3.0:1788625189.887358:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a3e5 00000100:00080000:3.0:1788625189.887371:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9987438d5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788625189.887436:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:0.0:1788625189.888820:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625189.888849:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:0.0:1788625189.888863:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2390:x1875509185103232:12345-192.168.204.14@tcp:9:kworker.0 00000020:00000080:0.0:1788625189.888893:0:8424:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a3ec 00000100:00080000:0.0:1788625189.888905:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9987438d6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788625189.888962:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788625189.889119:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+2:2390:x1875509185103232:12345-192.168.204.14@tcp:9:kworker.0 Request processed in 259us (3707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625189.889127:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00080000:0.0:1788625189.889162:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625189.889168:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625189.889171:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788625189.889174:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625189.890813:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+2:2390:x1875509185103104:12345-192.168.204.14@tcp:9:kworker.0 Request processed in 3469us (5483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625189.890827:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 22 00010000:00010000:1.0:1788625189.892334:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625189.970348:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625190.990229:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788625191.536855:0:13031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788625191.694232:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206154112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625191.694313:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625191.695144:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206154112 00000100:00100000:0.0:1788625191.695154:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206154112 00000100:00100000:0.0:1788625191.695277:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788625191.695296:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206154112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625191.695336:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788625191.695394:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206154112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625191.695401:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788625191.696160:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206154112:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788625192.014462:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625192.203723:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206154240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625192.203830:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625192.203952:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206154240 00000100:00100000:1.0:1788625192.203964:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206154240 00000100:00100000:1.0:1788625192.204031:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788625192.204045:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206154240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625192.204085:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788625192.208285:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625192.209109:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206154240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5060us (5270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625192.209129:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1788625192.209152:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743835f80 x1875509206154240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625192.209199:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206154240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625192.212121:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206154368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625192.212300:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625192.212679:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206154368 00000100:00100000:1.0:1788625192.212692:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206154368 00000100:00100000:1.0:1788625192.212903:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788625192.212911:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625192.212918:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206154368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788625192.212956:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625192.213039:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206154368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625192.213047:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1788625192.213156:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743a75c00 x1875509206154368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625192.213182:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206154368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625192.717709:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206154496:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.717803:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625192.717859:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206155008:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.717887:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625192.717905:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206155520:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.717929:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625192.717970:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788625192.717976:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206154624:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.718000:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625192.718018:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206155136:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.718039:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625192.718055:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206155648:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.718079:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625192.718110:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206154880:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.718135:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625192.718153:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206155392:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.718172:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625192.718188:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788625192.718193:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206154752:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.718215:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625192.718230:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206155264:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.718247:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625192.718256:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206155776:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.718278:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625192.718310:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206155008 00000100:00100000:0.0:1788625192.718320:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206155008 00000100:00100000:0.0:1788625192.718365:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206154752 00000100:00100000:0.0:1788625192.718368:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206154752 00000100:00100000:0.0:1788625192.718385:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788625192.718393:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206155008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.718455:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206155008:12345-0@lo:400:kworker.0 Request processed in 62us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625192.718474:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788625192.718492:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788625192.718498:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206154752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.718562:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206154752:12345-0@lo:400:kworker.0 Request processed in 63us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625192.718568:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788625192.718586:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206155648 00000100:00100000:0.0:1788625192.718590:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206155648 00000100:00100000:0.0:1788625192.718644:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206155776 00000100:00100000:0.0:1788625192.718648:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206155776 00000100:00100000:0.0:1788625192.718671:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788625192.718678:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206155648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.718710:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206155648:12345-0@lo:400:kworker.0 Request processed in 33us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625192.718716:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788625192.718727:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788625192.718732:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206155776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.718759:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206155776:12345-0@lo:400:kworker.0 Request processed in 27us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625192.718764:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788625192.718780:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206155520 00000100:00100000:0.0:1788625192.718783:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206155520 00000100:00100000:0.0:1788625192.718802:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206154624 00000100:00100000:0.0:1788625192.718806:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206154624 00000100:00100000:0.0:1788625192.718816:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206155136 00000100:00100000:0.0:1788625192.718819:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206155136 00000100:00100000:0.0:1788625192.718832:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206154880 00000100:00100000:0.0:1788625192.718842:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206154880 00000100:00100000:0.0:1788625192.718858:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206155392 00000100:00100000:0.0:1788625192.718860:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206155392 00000100:00100000:0.0:1788625192.718872:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206155264 00000100:00100000:0.0:1788625192.718875:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206155264 00000100:00100000:0.0:1788625192.718888:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788625192.718894:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206155520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.718925:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206155520:12345-0@lo:400:kworker.0 Request processed in 32us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625192.718931:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788625192.718941:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788625192.718947:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206154624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.718974:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206154624:12345-0@lo:400:kworker.0 Request processed in 28us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625192.718980:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788625192.718990:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788625192.718994:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206155136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.719026:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206155136:12345-0@lo:400:kworker.0 Request processed in 26us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625192.719032:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788625192.719044:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788625192.719051:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206154880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.719080:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206154880:12345-0@lo:400:kworker.0 Request processed in 31us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625192.719087:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788625192.719099:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788625192.719106:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206155392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625192.719107:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206154496 00000100:00100000:2.0:1788625192.719119:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206154496 00000100:00100000:0.0:1788625192.719148:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206155392:12345-0@lo:400:kworker.0 Request processed in 42us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625192.719156:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788625192.719166:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788625192.719175:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788625192.719178:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206154496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.719187:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206155264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625192.719235:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206154496:12345-0@lo:400:kworker.0 Request processed in 60us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625192.719238:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206155264:12345-0@lo:400:kworker.0 Request processed in 53us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625192.719251:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788625192.719253:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:2.0:1788625192.719294:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788625192.719300:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788625192.719303:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625192.719331:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206154752:0@lo:400:kworker.0 00010000:00080000:0.0:1788625192.719349:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439fd180 x1875509206155264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625192.719360:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206155264:0@lo:400:kworker.0 00010000:00080000:0.0:1788625192.719371:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439fc380 x1875509206155776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625192.719379:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206155776:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.719390:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206154880:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.719399:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206155392:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.720728:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206154624:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.720745:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206155136:0@lo:400:kworker.0 00010000:00080000:0.0:1788625192.720760:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439ff100 x1875509206155648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625192.720770:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206155648:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.720791:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206154496:0@lo:400:kworker.0 00000100:00100000:0.0:1788625192.720805:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206155008:0@lo:400:kworker.0 00010000:00080000:0.0:1788625192.720817:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439ff800 x1875509206155520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625192.720825:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206155520:0@lo:400:kworker.0 00010000:00010000:1.0:1788625193.035850:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625193.227947:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625193.227981:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206155904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625193.228086:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625193.228445:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206155904 00000100:00100000:0.0:1788625193.228456:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206155904 00000100:00100000:0.0:1788625193.228568:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788625193.228580:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206155904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788625193.228641:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788625193.229000:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206156032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625193.229044:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625193.229100:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206156032 00000100:00100000:2.0:1788625193.229105:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206156032 00000100:00100000:2.0:1788625193.229141:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788625193.229149:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206156032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788625193.229173:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625193.229226:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206156032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625193.229234:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1788625193.229298:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743a77480 x1875509206156032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625193.229321:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206156032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625193.230178:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206155904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1594us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625193.230189:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788625193.230916:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625193.230933:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206156160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625193.230993:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625193.231055:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206156160 00000100:00100000:2.0:1788625193.231063:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206156160 00000100:00100000:2.0:1788625193.231107:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788625193.231117:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206156160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625193.231142:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625193.231201:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206156160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625193.231207:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1788625193.231250:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743a77480 x1875509206156160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625193.231299:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206156160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625193.235470:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206155904:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788625194.063498:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788625194.595471:0:13179:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed81c42e0 20000000:00000080:3.0:1788625194.595488:0:13179:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9987426e0400 uarg=0000000000000000 20000000:01000000:3.0:1788625194.595786:0:13179:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788625194.595792:0:13179:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788625194.595797:0:13179:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788625194.596367:0:13180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788625194.596721:0:13179:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788625194.605779:0:13179:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788625194.605820:0:13179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a3f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.605840:0:13179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887cac6e00/0x2d2e3b3f34a7a38a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a383 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.605848:0:13179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a398 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a391 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.605855:0:13179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a3a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a39f expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.605861:0:13179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998859be9400/0x2d2e3b3f34a7a3b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a3ad expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.605871:0:13179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a3bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfa3 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.605877:0:13179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a3d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfe2 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.605884:0:13179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a3f3 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.606011:0:13179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a3d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfe2 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.606094:0:13179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a3d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfe2 expref: 12 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625194.606109:0:13179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13179:1875509206156288:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625194.606291:0:13179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a3bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfa3 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.606298:0:13179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a3bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfa3 expref: 12 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625194.606307:0:13179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb10e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13179:1875509206156416:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625194.606334:0:13179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998859be9400/0x2d2e3b3f34a7a3b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a3ad expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.606341:0:13179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998859be9400/0x2d2e3b3f34a7a3b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a3ad expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625194.606348:0:13179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb10700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13179:1875509206156544:0@lo:104: 00000100:00100000:3.0:1788625194.606388:0:13179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625194.606430:0:13179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a3a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a39f expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.606438:0:13179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a3a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a39f expref: 23 pid: 6503 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625194.606446:0:13179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13179:1875509206156672:0@lo:104: 00000100:00100000:3.0:1788625194.606467:0:13179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625194.606617:0:13179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a391 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.606625:0:13179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a398 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a391 expref: 23 pid: 6503 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625194.606638:0:13179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13179:1875509206156800:0@lo:104: 00000100:00100000:3.0:1788625194.606667:0:13179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625194.607997:0:13179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887cac6e00/0x2d2e3b3f34a7a38a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a383 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.608011:0:13179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887cac6e00/0x2d2e3b3f34a7a38a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a383 expref: 23 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625194.608035:0:13179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13179:1875509206156928:0@lo:104: 00000100:00100000:3.0:1788625194.608083:0:13179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625194.608743:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206156544 00000100:00100000:2.0:1788625194.608753:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206156544 00000100:00100000:2.0:1788625194.608801:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206156672 00000100:00100000:2.0:1788625194.608805:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206156672 00000100:00100000:2.0:1788625194.608816:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206156800 00000100:00100000:2.0:1788625194.608818:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206156800 00000100:00100000:2.0:1788625194.608830:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788625194.608839:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:13179:x1875509206156544:12345-0@lo:104: 00010000:00010000:2.0:1788625194.608855:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a3ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a3b4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.609511:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625194.609534:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:13179:x1875509206156544:12345-0@lo:104: Request processed in 680us (3129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625194.609542:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788625194.609561:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788625194.609567:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:13179:x1875509206156672:12345-0@lo:104: 00010000:00010000:2.0:1788625194.609586:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887c995c00/0x2d2e3b3f34a7a39f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a3a6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.609620:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788625194.609625:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:13179:x1875509206156672:12345-0@lo:104: Request processed in 59us (3158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625194.609630:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788625194.609696:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788625194.609702:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:13179:x1875509206156800:12345-0@lo:104: 00010000:00010000:2.0:1788625194.609722:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7a391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a398 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.609751:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788625194.609755:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:13179:x1875509206156800:12345-0@lo:104: Request processed in 54us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625194.609761:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1788625194.609782:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788625194.609787:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a3ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a3b4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.609794:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6a00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625194.609798:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a3ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a3b4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.609806:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a3ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a3b4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625194.609813:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a3ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a3b4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625194.609819:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788625194.609850:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a3ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a3b4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.609856:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625194.609875:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a3ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a3b4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.609882:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887cac6a00/0x2d2e3b3f34a7a3ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a3b4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.609969:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625194.609972:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887c995c00/0x2d2e3b3f34a7a39f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a3a6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.609978:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995c00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625194.609980:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887c995c00/0x2d2e3b3f34a7a39f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a3a6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.609987:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887c995c00/0x2d2e3b3f34a7a39f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a3a6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625194.609994:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887c995c00/0x2d2e3b3f34a7a39f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a3a6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625194.609998:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788625194.610012:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887c995c00/0x2d2e3b3f34a7a39f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a3a6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.610077:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625194.610084:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887c995c00/0x2d2e3b3f34a7a39f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a3a6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.610090:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887c995c00/0x2d2e3b3f34a7a39f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a3a6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.610099:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625194.610102:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7a391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a398 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.610117:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683400 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625194.610120:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7a391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a398 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.610127:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7a391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a398 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625194.610133:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7a391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a398 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625194.610337:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788625194.610354:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7a391 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a398 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.610360:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625194.610388:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7a391 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a398 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.610395:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7a391 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a398 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.610404:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625194.610406:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625194.610408:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625194.610415:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625194.610420:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625194.610446:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206157056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625194.610486:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625194.610536:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625194.610550:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206157184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625194.610586:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625194.610613:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625194.610621:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206157312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625194.611370:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625194.611423:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206157056 00000100:00100000:2.0:1788625194.611430:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206157056 00010000:00010000:2.0:1788625194.611456:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998859be9400/0x2d2e3b3f34a7a3b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a3ad expref: 24 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625194.611482:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206157184 00000100:00100000:2.0:1788625194.611485:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206157184 00010000:00010000:2.0:1788625194.611497:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a3a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a39f expref: 25 pid: 6503 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625194.611511:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206157312 00000100:00100000:2.0:1788625194.611514:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206157312 00010000:00010000:2.0:1788625194.611551:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a398 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a391 expref: 26 pid: 6503 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625194.611566:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788625194.611584:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+26:3637:x1875509206157056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625194.611596:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625194.611601:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998859be9400/0x2d2e3b3f34a7a3b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a3ad expref: 26 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.611611:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998859be9400/0x2d2e3b3f34a7a3b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a3ad expref: 26 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.611629:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625194.611682:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+26:3637:x1875509206157056:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625194.611688:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788625194.611702:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788625194.611707:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844934700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+25:3637:x1875509206157184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625194.611714:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625194.611718:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a3a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a39f expref: 25 pid: 6503 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.611727:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a3a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a39f expref: 25 pid: 6503 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.611736:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625194.611759:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844934700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+25:3637:x1875509206157184:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625194.611764:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788625194.611775:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788625194.611780:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206157312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625194.611787:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625194.611791:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a398 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a391 expref: 24 pid: 6503 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.611799:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a398 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a391 expref: 24 pid: 6503 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.611808:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625194.611845:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206157312:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625194.611851:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788625194.612114:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206157312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625194.612192:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625194.612363:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185103488 00000100:00100000:0.0:1788625194.612368:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185103488 00010000:00010000:0.0:1788625194.612386:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a3bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfa3 expref: 13 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625194.612416:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 43 00000100:00100000:0.0:1788625194.612423:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185103488:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625194.612431:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625194.612434:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a3bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfa3 expref: 13 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625194.612492:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206157184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625194.612501:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206157056:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625194.612635:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a3bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfa3 expref: 13 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625194.612647:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625194.612702:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185103488:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 279us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625194.612708:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 43 00000100:00100000:3.0:1788625194.614883:0:13179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438ff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625194.614930:0:13179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13179:1875509206156288:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625194.614943:0:13179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a3bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfa3 expref: 12 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625194.614960:0:13179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb10e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13179:1875509206156416:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625194.614972:0:13179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be9400/0x2d2e3b3f34a7a3b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a3ad expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625194.614979:0:13179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb10700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13179:1875509206156544:0@lo:104: 00010000:00010000:3.0:1788625194.614988:0:13179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be9200/0x2d2e3b3f34a7a3a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a39f expref: 22 pid: 6503 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625194.614994:0:13179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13179:1875509206156672:0@lo:104: 00010000:00010000:3.0:1788625194.615003:0:13179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a398 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a391 expref: 21 pid: 6503 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625194.615009:0:13179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13179:1875509206156800:0@lo:104: 00000100:00100000:2.0:1788625194.615235:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206156928 00000100:00100000:2.0:1788625194.615243:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206156928 00000100:00100000:2.0:1788625194.615314:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788625194.615323:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:13179:x1875509206156928:12345-0@lo:104: 00010000:00010000:2.0:1788625194.615340:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998859be8400/0x2d2e3b3f34a7a383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a38a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.615428:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625194.615435:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:13179:x1875509206156928:12345-0@lo:104: Request processed in 113us (7350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625194.615441:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788625194.615464:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625194.615470:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be8400/0x2d2e3b3f34a7a383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a38a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.615477:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8400 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625194.615482:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be8400/0x2d2e3b3f34a7a383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a38a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.615490:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be8400/0x2d2e3b3f34a7a383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a38a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625194.615498:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be8400/0x2d2e3b3f34a7a383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a38a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625194.615503:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788625194.615591:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998859be8400/0x2d2e3b3f34a7a383 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a38a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.615597:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625194.615621:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be8400/0x2d2e3b3f34a7a383 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a38a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.615628:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be8400/0x2d2e3b3f34a7a383 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a38a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.615658:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625194.615660:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625194.615661:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625194.615670:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625194.615682:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206157440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625194.615721:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625194.615749:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206157440 00000100:00100000:2.0:1788625194.615753:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206157440 00010000:00010000:2.0:1788625194.615769:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887cac6e00/0x2d2e3b3f34a7a38a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a383 expref: 21 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625194.615791:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788625194.615798:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:3635:x1875509206157440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625194.615809:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625194.615815:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887cac6e00/0x2d2e3b3f34a7a38a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a383 expref: 21 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.615823:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887cac6e00/0x2d2e3b3f34a7a38a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a383 expref: 21 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625194.615831:0:13179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13179:1875509206156928:0@lo:104: 00010000:00010000:2.0:1788625194.615836:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac6e00/0x2d2e3b3f34a7a38a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a383 expref: 21 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.615852:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625194.615858:0:13179:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a3f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625194.615878:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:3635:x1875509206157440:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625194.615884:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788625194.616113:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206157440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625194.616860:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625194.617090:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185103360 00000100:00100000:2.0:1788625194.617098:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185103360 00010000:00010000:2.0:1788625194.617126:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a3d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfe2 expref: 12 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625194.617232:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 45 00000100:00100000:2.0:1788625194.617241:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:2394:x1875509185103360:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625194.617256:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625194.617331:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a3d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfe2 expref: 12 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.617344:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a3d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfe2 expref: 12 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.617360:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a3d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfe2 expref: 12 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.617375:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a3f3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.617385:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a3f3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.617418:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a3f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.617426:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a3f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.617433:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a3f3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.617441:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a3f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.617447:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625194.617451:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a3f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.617459:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a3f3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.617891:0:13179:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a3f3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625194.617979:0:13179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a3f3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.619818:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a3f3 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.619837:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7a3f3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625194.619859:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625194.619950:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:2394:x1875509185103360:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 2705us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625194.619961:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 45 00000100:00100000:2.0:1788625195.003967:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625195.004043:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625195.004088:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625195.004123:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625195.004231:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185103744 00000100:00100000:1.0:1788625195.004245:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185103744 00000100:00100000:1.0:1788625195.004336:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185104000 00000100:00100000:1.0:1788625195.004340:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185104000 00000100:00100000:1.0:1788625195.004359:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185103616 00000100:00100000:1.0:1788625195.004362:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185103616 00000100:00100000:1.0:1788625195.004374:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185103872 00000100:00100000:1.0:1788625195.004376:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185103872 00000100:00100000:1.0:1788625195.004394:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 184 00000100:00100000:1.0:1788625195.004405:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185103744:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625195.004501:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185103744:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 98us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625195.004510:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 184 00000100:00100000:1.0:1788625195.004569:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 185 00000100:00100000:1.0:1788625195.004576:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185104000:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625195.004599:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185104000:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 23us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625195.004605:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 185 00000100:00100000:1.0:1788625195.004625:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 186 00000100:00100000:1.0:1788625195.004631:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185103616:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625195.004657:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185103616:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 27us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625195.004663:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 186 00000100:00100000:1.0:1788625195.004674:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 187 00000100:00100000:1.0:1788625195.004679:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185103872:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625195.004699:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185103872:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 20us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625195.004704:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 187 00000100:00080000:2.0:1788625195.005127:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788625195.005132:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788625195.083867:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788625195.725062:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788625195.725072:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9988449c9000 from 7 10000000:01000000:3.0:1788625195.725077:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625195.725124:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a3fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625195.725138:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a3fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625195.725150:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a3fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625195.725176:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206157568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625195.725274:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625195.725341:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438ffa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625195.726579:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206157568 00000100:00100000:2.0:1788625195.726592:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206157568 00000100:00100000:2.0:1788625195.726659:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788625195.726672:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206157568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625195.726690:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625195.726710:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a401 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a3fa expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625195.726750:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a3fa expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625195.726762:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a3fa expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625195.726772:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6a00, rc 0) 00000100:00100000:2.0:1788625195.726857:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206157568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625195.726865:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788625195.727224:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206157568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625195.727246:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a3fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625195.727258:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a3fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625195.727337:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206157696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625195.727378:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625195.727420:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438ffa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625195.727485:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206157696 00000100:00100000:2.0:1788625195.727491:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206157696 00000100:00100000:2.0:1788625195.728007:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788625195.728017:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206157696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625195.728146:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206157696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625195.728160:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788625195.728281:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206157696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625195.728318:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206157824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625195.728439:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625195.728474:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851a19c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625195.728662:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206157824 00000100:00100000:2.0:1788625195.728668:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206157824 00000100:00100000:2.0:1788625195.728699:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788625195.728706:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206157824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625195.728812:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206157824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625195.728819:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788625195.728991:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206157824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788625195.730146:0:13219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788625195.730695:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788625195.730721:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625195.730743:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a3fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625195.730757:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a3fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625195.730768:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788625195.730770:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998878127800 from 7 10000000:01000000:2.0:1788625195.730773:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788625195.730807:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a408 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625195.730816:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a408 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625195.730826:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a408 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625195.730849:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206157952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788625195.730919:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625195.730956:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788625195.730976:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206157952 00000100:00100000:2.0:1788625195.730982:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206157952 00000100:00100000:2.0:1788625195.731030:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788625195.731039:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206157952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625195.731050:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625195.731064:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a40f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a408 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625195.731088:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a40f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a408 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625195.731099:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a40f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a408 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625195.731107:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6000, rc 0) 00000100:00100000:2.0:1788625195.731150:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206157952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625195.731156:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788625195.731259:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206157952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625195.731277:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a408 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a40f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625195.731288:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a408 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a40f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625195.731343:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625195.731371:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625195.731459:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c646c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625195.732591:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206158080 00000100:00100000:2.0:1788625195.732602:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206158080 00000100:00100000:2.0:1788625195.732653:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788625195.732662:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206158080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625195.732810:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206158080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625195.732818:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788625195.733024:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625195.733073:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625195.733118:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625195.733151:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c646c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625195.733194:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206158208 00000100:00100000:2.0:1788625195.733205:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206158208 00000100:00100000:2.0:1788625195.733237:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788625195.733243:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206158208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625195.733313:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206158208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625195.733319:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788625195.733612:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788625195.735085:0:13221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788625195.735853:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788625195.735882:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788625195.735894:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a408 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a40f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625195.735909:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a40f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625195.735920:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788625195.735922:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99886c323000 from 7 10000000:01000000:3.0:1788625195.735925:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625195.735968:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682000/0x2d2e3b3f34a7a416 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625195.735976:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b682000/0x2d2e3b3f34a7a416 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625195.735987:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b682000/0x2d2e3b3f34a7a416 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625195.736014:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625195.736086:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625195.736133:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438ff240 going to sleep for 11 seconds 00000100:00100000:2.0:1788625195.736250:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206158336 00000100:00100000:2.0:1788625195.736258:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206158336 00000100:00100000:2.0:1788625195.736307:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788625195.736317:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206158336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625195.736331:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625195.736344:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a41d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a416 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625195.736369:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a41d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a416 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625195.736381:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a41d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a416 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625195.736390:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7800, rc 0) 00000100:00100000:2.0:1788625195.736533:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206158336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625195.736541:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788625195.736673:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625195.736688:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b682000/0x2d2e3b3f34a7a416 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a41d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625195.736697:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b682000/0x2d2e3b3f34a7a416 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a41d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625195.736759:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625195.736788:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625195.736816:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c64c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625195.738056:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206158464 00000100:00100000:2.0:1788625195.738069:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206158464 00000100:00100000:2.0:1788625195.738123:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788625195.738133:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206158464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625195.738321:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206158464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625195.738329:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788625195.738779:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625195.738829:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625195.738879:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625195.738916:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c64c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625195.738962:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206158592 00000100:00100000:2.0:1788625195.738967:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206158592 00000100:00100000:2.0:1788625195.739002:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788625195.739010:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206158592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625195.739098:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206158592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625195.739105:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788625195.739151:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788625195.745092:0:13222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788625195.745168:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788625195.745191:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625195.745205:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682000/0x2d2e3b3f34a7a416 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a41d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625195.745219:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b682000/0x2d2e3b3f34a7a416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a41d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625195.745244:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788625195.745246:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998852348000 from 7 10000000:01000000:1.0:1788625195.745249:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625195.745288:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882045a00/0x2d2e3b3f34a7a424 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625195.745298:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998882045a00/0x2d2e3b3f34a7a424 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625195.745309:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998882045a00/0x2d2e3b3f34a7a424 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625195.745335:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788625195.745810:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625195.745859:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625195.746136:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206158720 00000100:00100000:0.0:1788625195.746144:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206158720 00000100:00100000:0.0:1788625195.746197:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788625195.746207:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206158720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625195.746222:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625195.746237:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887c994400/0x2d2e3b3f34a7a42b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a424 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625195.746262:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887c994400/0x2d2e3b3f34a7a42b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a424 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625195.746273:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887c994400/0x2d2e3b3f34a7a42b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a424 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625195.746314:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994400, rc 0) 00000100:00100000:0.0:1788625195.746362:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206158720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625195.746369:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788625195.748166:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625195.748207:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998882045a00/0x2d2e3b3f34a7a424 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625195.748220:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998882045a00/0x2d2e3b3f34a7a424 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625195.748314:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625195.748386:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625195.748430:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625195.748571:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206158848 00000100:00100000:1.0:1788625195.748578:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206158848 00000100:00100000:1.0:1788625195.748628:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788625195.748636:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206158848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625195.748765:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206158848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625195.748773:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788625195.748814:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625195.748844:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625195.748885:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625195.748917:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625195.748934:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206158976 00000100:00100000:1.0:1788625195.748937:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206158976 00000100:00100000:1.0:1788625195.748964:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788625195.748972:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206158976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625195.749054:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206158976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625195.749061:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788625195.749100:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206158976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788625195.749760:0:13226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788625195.749814:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788625195.749830:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625195.749838:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882045a00/0x2d2e3b3f34a7a424 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625195.749850:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998882045a00/0x2d2e3b3f34a7a424 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788625195.792429:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 44e8506e-584d-40a5-8ecc-bc286c2e90c7 00000020:00000080:3.0:1788625195.792441:0:8419:0:(genops.c:885:class_export_put()) final put ffff9987438d6000/44e8506e-584d-40a5-8ecc-bc286c2e90c7 00000020:00000080:0.0:1788625195.792561:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9987438d6000/44e8506e-584d-40a5-8ecc-bc286c2e90c7 for lustre-OST0000 00000020:00000080:0.0:1788625195.792617:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9987438d5000 for lustre-OST0000 00000001:00100000:3.0:1788625195.794628:0:9503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 44e8506e-584d-40a5-8ecc-bc286c2e90c7 00000020:00000080:3.0:1788625195.794636:0:9503:0:(genops.c:885:class_export_put()) final put ffff9987438d1800/44e8506e-584d-40a5-8ecc-bc286c2e90c7 00000020:00000080:0.0:1788625195.795051:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9987438d1800/44e8506e-584d-40a5-8ecc-bc286c2e90c7 for lustre-OST0001 00000020:00000080:0.0:1788625195.795104:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9987438d6800 for lustre-OST0001 00000100:00100000:0.0:1788625195.904176:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625195.904280:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185104128 00000100:00100000:1.0:1788625195.904289:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185104128 00000100:00100000:1.0:1788625195.904347:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 326 00000100:00100000:1.0:1788625195.904356:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:6164:x1875509185104128:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625195.905342:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625195.905373:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998882045800/0x2d2e3b3f34a7a432 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e013 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625195.905404:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998882045800/0x2d2e3b3f34a7a432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e013 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625195.905417:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998882045800/0x2d2e3b3f34a7a432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e013 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625195.905426:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882045800, rc 0) 00000100:00100000:1.0:1788625195.905485:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:6164:x1875509185104128:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 Request processed in 1130us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625195.905493:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 326 00000100:00100000:1.0:1788625195.915575:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625195.915978:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185104256 00000100:00100000:2.0:1788625195.915989:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185104256 00000100:00100000:2.0:1788625195.916088:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 327 00000100:00100000:2.0:1788625195.916099:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:6164:x1875509185104256:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625195.916271:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:6164:x1875509185104256:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 Request processed in 174us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625195.916280:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 327 00000100:00100000:0.0:1788625195.919056:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625195.919432:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185104384 00000100:00100000:2.0:1788625195.919444:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185104384 00000100:00100000:2.0:1788625195.919500:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 328 00000100:00100000:2.0:1788625195.919509:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:6164:x1875509185104384:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625195.922788:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:6164:x1875509185104384:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 Request processed in 3267us (3727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625195.922815:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 328 00000100:00100000:2.0:1788625195.932684:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625195.933041:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185104512 00000100:00100000:1.0:1788625195.933053:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185104512 00000100:00100000:1.0:1788625195.933157:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 329 00000100:00100000:1.0:1788625195.933169:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:6164:x1875509185104512:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625195.933188:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625195.933205:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998882044800/0x2d2e3b3f34a7a439 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e01a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625195.933261:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998882044800/0x2d2e3b3f34a7a439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e01a expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625195.933273:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998882044800/0x2d2e3b3f34a7a439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e01a expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625195.933283:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882044800, rc 0) 00000100:00100000:1.0:1788625195.933347:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:6164:x1875509185104512:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 Request processed in 181us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625195.933354:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 329 00000100:00100000:1.0:1788625195.940429:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625195.940554:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185104640 00000100:00100000:2.0:1788625195.940567:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185104640 00000100:00100000:2.0:1788625195.940745:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 330 00000100:00100000:2.0:1788625195.940757:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:6164:x1875509185104640:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625195.940970:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:6164:x1875509185104640:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 Request processed in 214us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625195.940979:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 330 00000100:00100000:3.0:1788625195.944731:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625195.944827:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185104768 00000100:00100000:1.0:1788625195.944837:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185104768 00000100:00100000:1.0:1788625195.944910:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 331 00000100:00100000:1.0:1788625195.944922:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:6164:x1875509185104768:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625195.945292:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:6164:x1875509185104768:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 Request processed in 371us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625195.945303:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 331 00010000:00010000:2.0:1788625196.108750:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625196.815797:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206159104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625196.815991:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625196.816087:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206159104 00000100:00100000:1.0:1788625196.816096:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206159104 00000100:00100000:1.0:1788625196.816146:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788625196.816155:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206159104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788625196.816190:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788625196.820022:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206159104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3852us (4015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625196.820032:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206159104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625196.820055:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00010000:0.0:1788625197.131739:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625197.324126:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625197.324150:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206159232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625197.324226:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625197.327325:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206159360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625197.327394:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625197.327465:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206159232 00000100:00100000:1.0:1788625197.327473:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206159232 00000100:00100000:1.0:1788625197.327543:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206159360 00000100:00100000:1.0:1788625197.327547:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206159360 00000100:00100000:1.0:1788625197.327567:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788625197.327575:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206159232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788625197.327606:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625197.327660:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206159232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (3433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625197.327667:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788625197.327683:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788625197.327690:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206159360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625197.327703:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625197.327732:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206159360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625197.327738:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788625197.327753:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788625197.327782:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743836680 x1875509206159360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625197.327800:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206159360:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788625197.328967:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987438cd880 x1875509206159232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625197.328986:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206159232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788625197.837885:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206159488:0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.837912:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206159872:0@lo:400:kworker.0 00000100:00100000:0.0:1788625197.837956:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206159616:0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.838015:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625197.838093:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206160384:0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.838115:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625197.838139:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788625197.838145:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206160000:0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.838170:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625197.838189:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206160512:0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.838206:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625197.838229:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206159744:0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.838251:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625197.838268:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206160256:0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.838288:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625197.838303:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206160768:0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.838321:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625197.838360:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206159872 00000100:00100000:3.0:1788625197.838367:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206159872 00000100:00100000:3.0:1788625197.838407:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206160384 00000100:00100000:3.0:1788625197.838410:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206160384 00000100:00100000:3.0:1788625197.838740:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206160512 00000100:00100000:3.0:1788625197.838744:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206160512 00000100:00100000:3.0:1788625197.838759:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206160256 00000100:00100000:3.0:1788625197.838761:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206160256 00000100:00100000:3.0:1788625197.838778:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788625197.838787:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206159872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.838844:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206159872:12345-0@lo:400:kworker.0 Request processed in 57us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625197.838850:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788625197.838867:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788625197.838880:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206160384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.838912:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206160384:12345-0@lo:400:kworker.0 Request processed in 34us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625197.838918:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788625197.838929:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788625197.838935:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206160512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.838963:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206160512:12345-0@lo:400:kworker.0 Request processed in 29us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625197.838969:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788625197.838980:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788625197.838985:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206160256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.839014:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206160256:12345-0@lo:400:kworker.0 Request processed in 29us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625197.839020:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788625197.839038:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206160000 00000100:00100000:3.0:1788625197.839041:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206160000 00000100:00100000:3.0:1788625197.839054:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206159744 00000100:00100000:3.0:1788625197.839056:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206159744 00000100:00100000:3.0:1788625197.839065:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788625197.839070:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206160000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.839097:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206160000:12345-0@lo:400:kworker.0 Request processed in 27us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625197.839102:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788625197.839113:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788625197.839118:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206159744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.839141:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206159744:12345-0@lo:400:kworker.0 Request processed in 24us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625197.839152:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1788625197.839180:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625197.839184:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625197.839210:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206159744:0@lo:400:kworker.0 00010000:00080000:3.0:1788625197.839223:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c60a80 x1875509206160256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625197.839233:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206160256:0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.839261:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206160000:0@lo:400:kworker.0 00010000:00080000:3.0:1788625197.839271:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c62300 x1875509206160512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625197.839279:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206160512:0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.839288:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206159872:0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.839297:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206160384:0@lo:400:kworker.0 00000100:00100000:1.0:1788625197.840690:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625197.840853:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206159488 00000100:00100000:3.0:1788625197.840861:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206159488 00000100:00100000:3.0:1788625197.840908:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788625197.840917:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206159488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625197.840984:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206159488:12345-0@lo:400:kworker.0 Request processed in 69us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625197.840991:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788625197.841333:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206159488:0@lo:400:kworker.0 00000100:00100000:1.0:1788625197.843649:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206160768 00000100:00100000:1.0:1788625197.843661:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206160768 00000100:00100000:1.0:1788625197.844297:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788625197.844314:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206160768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625197.844396:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206160768:12345-0@lo:400:kworker.0 Request processed in 89us (6072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625197.844403:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000001:02000400:2.0:1788625197.845326:0:13377:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788625197.845958:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625197.846009:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206160128:0@lo:400:kworker.0 00000100:00100000:0.0:1788625197.846045:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625197.846171:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206160640:0@lo:400:kworker.0 00000100:00100000:0.0:1788625197.846199:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625197.846240:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206160640 00000100:00100000:0.0:1788625197.846254:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206160640 00000100:00100000:0.0:1788625197.846300:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788625197.846308:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206160640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625197.846353:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206160640:12345-0@lo:400:kworker.0 Request processed in 46us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625197.846360:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788625197.846383:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206159616 00000100:00100000:0.0:1788625197.846386:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206159616 00000100:00100000:0.0:1788625197.846405:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206160128 00000100:00100000:0.0:1788625197.846408:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206160128 00000100:00100000:0.0:1788625197.846498:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788625197.846531:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206159616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625197.846567:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206159616:12345-0@lo:400:kworker.0 Request processed in 62us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625197.846573:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788625197.846584:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788625197.846589:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206160128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625197.846613:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206160128:12345-0@lo:400:kworker.0 Request processed in 25us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625197.846618:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788625197.846733:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206159616:0@lo:400:kworker.0 00000100:00100000:0.0:1788625197.846744:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206160128:0@lo:400:kworker.0 00010000:00080000:0.0:1788625197.846754:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c61880 x1875509206160640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625197.846764:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206160640:0@lo:400:kworker.0 00000100:00080000:3.0:1788625197.848219:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625197.848227:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788625197.848264:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c61500 x1875509206160768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625197.848292:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206160768:0@lo:400:kworker.0 00010000:00010000:2.0:1788625198.155819:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625198.348425:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625198.348452:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206160896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625198.348553:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625198.348892:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206160896 00000100:00100000:2.0:1788625198.348901:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206160896 00000100:00100000:2.0:1788625198.348957:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788625198.348967:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206160896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625198.348995:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625198.349700:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206160896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 732us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625198.349719:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788625198.351648:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743a77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206161152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625198.351735:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625198.351810:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206161152 00000100:00100000:0.0:1788625198.351818:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206161152 00000100:00100000:0.0:1788625198.351864:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788625198.351883:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206161152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788625198.351926:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788625198.351979:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206161152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625198.351987:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788625198.352035:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743a77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206161152:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1788625198.354646:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844936300 x1875509206160896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625198.354678:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206160896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625198.354719:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206161024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625198.356222:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625198.356548:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206161024 00000100:00100000:0.0:1788625198.356557:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206161024 00000100:00100000:0.0:1788625198.356605:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788625198.356616:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206161024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625198.356641:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625198.356705:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206161024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625198.356712:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1788625198.357198:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743836680 x1875509206161024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625198.357220:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206161024:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788625199.188883:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625200.127491:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625200.127581:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625200.127621:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625200.127650:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625200.127669:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625200.128157:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185104896 00000100:00100000:1.0:1788625200.128171:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185104896 00000100:00100000:1.0:1788625200.128244:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 333 00000100:00100000:1.0:1788625200.128259:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2392:x1875509185104896:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625200.128260:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185105152 00000100:00100000:2.0:1788625200.128285:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185105152 00000100:00100000:2.0:1788625200.128338:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185105408 00000100:00100000:2.0:1788625200.128342:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185105408 00000100:00100000:1.0:1788625200.128362:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2392:x1875509185104896:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 107us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625200.128373:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185105024 00000100:00100000:1.0:1788625200.128373:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 333 00000100:00100000:2.0:1788625200.128378:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185105024 00000100:00100000:2.0:1788625200.128399:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185105280 00000100:00100000:2.0:1788625200.128401:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185105280 00000100:00100000:2.0:1788625200.128423:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 194 00000100:00100000:2.0:1788625200.128431:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2392:x1875509185105152:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625200.128485:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2392:x1875509185105152:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 54us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625200.128493:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 194 00000100:00100000:2.0:1788625200.128544:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 195 00000100:00100000:2.0:1788625200.128552:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2392:x1875509185105408:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625200.128725:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 196 00000100:00100000:0.0:1788625200.128736:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2392:x1875509185105024:12345-192.168.204.14@tcp:400:kworker.0 00000100:00080000:3.0:1788625200.128857:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625200.128862:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625200.128935:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 197 00000100:00100000:3.0:1788625200.128944:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2392:x1875509185105280:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625200.136128:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2392:x1875509185105408:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 7563us (8491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625200.136146:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 195 00000100:00100000:0.0:1788625200.136284:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2392:x1875509185105024:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 7548us (8630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625200.136311:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 196 00000100:00100000:3.0:1788625200.136331:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2392:x1875509185105280:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 7385us (8656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625200.136341:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 197 00010000:00010000:0.0:1788625200.203982:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625201.250045:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625201.933118:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206161280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625201.933369:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625201.933471:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206161280 00000100:00100000:3.0:1788625201.933480:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206161280 00000100:00100000:3.0:1788625201.933604:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788625201.933616:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206161280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788625201.933655:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788625201.941711:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206161280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8086us (8329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625201.941727:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788625201.947468:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206161280:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788625202.254240:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625202.443694:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206161408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625202.443767:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625202.443900:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206161408 00000100:00100000:0.0:1788625202.443909:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206161408 00000100:00100000:0.0:1788625202.443980:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788625202.443991:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206161408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625202.444022:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625202.444072:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206161408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625202.444079:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1788625202.444121:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439ff800 x1875509206161408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625202.444139:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206161408:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788625202.444246:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625202.444766:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206161536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625202.444803:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625202.444842:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206161536 00000100:00100000:2.0:1788625202.444846:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206161536 00000100:00100000:2.0:1788625202.444879:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788625202.444886:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206161536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625202.444910:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625202.444954:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206161536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625202.444960:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788625202.444977:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788625202.444995:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742e43b80 x1875509206161536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625202.445009:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206161536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625202.960862:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206161792:0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.960937:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625202.961001:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206162304:0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.961024:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625202.961047:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206162816:0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.961067:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625202.961103:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788625202.961109:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206161664:0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.961155:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625202.961180:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206162176:0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.961205:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625202.961221:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206162688:0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.961244:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625202.961277:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206161792 00000100:00100000:1.0:1788625202.961285:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206161792 00000100:00100000:1.0:1788625202.961332:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206162304 00000100:00100000:1.0:1788625202.961335:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206162304 00000100:00100000:1.0:1788625202.961359:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206162816 00000100:00100000:1.0:1788625202.961362:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206162816 00000100:00100000:1.0:1788625202.961380:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788625202.961389:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206161792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.961452:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206161792:12345-0@lo:400:kworker.0 Request processed in 64us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625202.961459:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788625202.961476:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788625202.961482:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206162304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.961509:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206162304:12345-0@lo:400:kworker.0 Request processed in 28us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625202.961542:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788625202.961556:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788625202.961562:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206162816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.961589:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206162816:12345-0@lo:400:kworker.0 Request processed in 28us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625202.961596:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788625202.961627:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206161664 00000100:00100000:1.0:1788625202.961631:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206161664 00000100:00100000:1.0:1788625202.961656:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788625202.961663:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206161664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.961692:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206161664:12345-0@lo:400:kworker.0 Request processed in 30us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625202.961699:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788625202.961739:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206162688 00000100:00100000:1.0:1788625202.961743:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206162688 00000100:00100000:1.0:1788625202.961770:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788625202.961778:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206162688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.961808:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206162688:12345-0@lo:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625202.961815:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788625202.961835:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206161920:0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.961858:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206161664:0@lo:400:kworker.0 00010000:00080000:1.0:1788625202.961872:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998741dc2300 x1875509206162688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625202.961884:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206162688:0@lo:400:kworker.0 00000100:00100000:2.0:1788625202.961891:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625202.961893:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206161792:0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.961901:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206162304:0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.961910:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206162816:0@lo:400:kworker.0 00000100:00100000:2.0:1788625202.961927:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206162432:0@lo:400:kworker.0 00000100:00100000:2.0:1788625202.961983:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625202.962038:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206162944:0@lo:400:kworker.0 00000100:00100000:2.0:1788625202.962076:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625202.962125:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788625202.962127:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206162432 00000100:00100000:1.0:1788625202.962131:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206162432 00000100:00100000:2.0:1788625202.962132:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206162048:0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.962154:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206162944 00000100:00100000:1.0:1788625202.962157:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206162944 00000100:00100000:1.0:1788625202.962183:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788625202.962187:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625202.962189:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206162432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.962218:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206162432:12345-0@lo:400:kworker.0 Request processed in 29us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625202.962220:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206162560:0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.962224:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788625202.962234:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206162048 00000100:00100000:1.0:1788625202.962237:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206162048 00000100:00100000:1.0:1788625202.962250:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788625202.962255:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206162944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625202.962258:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625202.962277:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206163072:0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.962280:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206162944:12345-0@lo:400:kworker.0 Request processed in 25us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625202.962286:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788625202.962295:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625202.962297:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788625202.962302:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206162048:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788625202.962318:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998741dc1180 x1875509206162432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625202.962326:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206162048:12345-0@lo:400:kworker.0 Request processed in 25us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625202.962328:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206162432:0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.962333:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00010000:00080000:2.0:1788625202.962346:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998741dc0a80 x1875509206162944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625202.962355:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206162944:0@lo:400:kworker.0 00000100:00100000:2.0:1788625202.962370:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206162048:0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.962558:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206163200:0@lo:400:kworker.0 00000100:00100000:1.0:1788625202.962585:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625202.963347:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206162176 00000100:00100000:2.0:1788625202.963353:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206162176 00000100:00100000:2.0:1788625202.963852:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206161920 00000100:00100000:2.0:1788625202.963857:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206161920 00000100:00100000:2.0:1788625202.963893:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788625202.963901:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206162176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625202.964019:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206162176:12345-0@lo:400:kworker.0 Request processed in 118us (2811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625202.964026:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788625202.964056:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788625202.964062:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206161920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625202.964134:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206161920:12345-0@lo:400:kworker.0 Request processed in 72us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625202.964140:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1788625202.964159:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788625202.964163:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625202.972283:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206162560 00000100:00100000:2.0:1788625202.972300:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206162560 00000100:00100000:2.0:1788625202.972382:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206163072 00000100:00100000:2.0:1788625202.972386:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206163072 00000100:00100000:2.0:1788625202.972422:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206163200 00000100:00100000:2.0:1788625202.972425:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206163200 00000100:00100000:2.0:1788625202.972446:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788625202.972476:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206162560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625202.972585:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206162560:12345-0@lo:400:kworker.0 Request processed in 113us (10325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625202.972593:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788625202.972610:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788625202.972734:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206163072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625202.972766:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206163072:12345-0@lo:400:kworker.0 Request processed in 35us (10470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625202.972773:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788625202.972785:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788625202.972791:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206163200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625202.972832:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206163200:12345-0@lo:400:kworker.0 Request processed in 41us (10246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625202.972838:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788625202.972870:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788625202.972906:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c5ce00 x1875509206163200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625202.972921:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206163200:0@lo:400:kworker.0 00010000:00080000:2.0:1788625202.972959:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998741dc0000 x1875509206162560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625202.972969:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206162560:0@lo:400:kworker.0 00010000:00080000:2.0:1788625202.972978:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c5c700 x1875509206163072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625202.972986:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206163072:0@lo:400:kworker.0 00000100:00100000:2.0:1788625202.973010:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206161920:0@lo:400:kworker.0 00000100:00100000:0.0:1788625202.973169:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206162176:0@lo:400:kworker.0 00000001:02000400:0.0:1788625203.123021:0:13526:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:20:00 (1788625200) === 00010000:00010000:0.0:1788625203.275807:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625203.416968:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625203.417031:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625203.417134:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185105664 00000100:00100000:2.0:1788625203.417152:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185105664 00000100:00100000:2.0:1788625203.417246:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 2 00000100:00100000:2.0:1788625203.417261:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:10502:x1875509185105664:12345-192.168.204.14@tcp:700:mkdir.0 00000100:00100000:2.0:1788625203.417354:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:10502:x1875509185105664:12345-192.168.204.14@tcp:700:mkdir.0 Request processed in 97us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625203.417362:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 2 00000100:00080000:3.0:1788625203.417695:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625203.417738:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185105536 00000100:00100000:1.0:1788625203.417745:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185105536 00000100:00100000:1.0:1788625203.417787:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 22 00000100:00100000:1.0:1788625203.417796:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185105536:12345-192.168.204.14@tcp:41:mkdir.0 00000004:00000024:1.0:1788625203.417821:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788625203.417873:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185105536:12345-192.168.204.14@tcp:41:mkdir.0 Request processed in 79us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625203.417897:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 22 00000100:00100000:1.0:1788625203.426425:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625203.428444:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185105920 00000100:00100000:0.0:1788625203.428461:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185105920 00000100:00100000:0.0:1788625203.428549:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:0.0:1788625203.428560:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:10502:x1875509185105920:12345-192.168.204.14@tcp:36:mkdir.0 00010000:00010000:0.0:1788625203.428628:0:11318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625203.428669:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a2e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df8e expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.428691:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9900) 00010000:00010000:0.0:1788625203.428752:0:11318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625203.428834:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a440 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.428849:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a440 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.428860:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a440 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.428889:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a447 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.428898:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a447 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.428905:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a447 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.431857:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a44e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.431879:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a44e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.431890:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a44e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625203.431909:0:11318:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0023aa3 reply state 00000000ed76f1f0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a44e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.431929:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a44e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.431937:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9988749c3b00) 00010000:00010000:0.0:1788625203.431939:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788625203.431943:0:11318:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788625203.431948:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788625203.431955:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a440 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.431962:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a440 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.431968:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a440 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.431974:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625203.431978:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a440 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.431985:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a440 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.431994:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c3700) 00010000:00010000:0.0:1788625203.431997:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625203.432000:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a440 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.432006:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a440 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625203.432035:0:11318:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0023aa3 reply state 00000000ed76f1f0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a447 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.432044:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a447 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.432050:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9988749c3a00) 00010000:00010000:0.0:1788625203.432052:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788625203.432054:0:11318:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788625203.432166:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:10502:x1875509185105920:12345-192.168.204.14@tcp:36:mkdir.0 Request processed in 3605us (5749us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788625203.432176:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:1.0:1788625203.448322:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625203.448510:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185106048 00000100:00100000:2.0:1788625203.448574:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185106048 00000100:00100000:2.0:1788625203.448648:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:2.0:1788625203.448659:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:10503:x1875509185106048:12345-192.168.204.14@tcp:101:chmod.0 00010000:00010000:2.0:1788625203.448682:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625203.448717:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a455 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e021 expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.448792:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a45c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.448806:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a45c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.448819:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a45c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625203.448876:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788625203.448880:0:9824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625203.448916:0:9824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a45c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.448963:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a455 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e021 expref: 9 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.448983:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a45c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e021 expref: 8 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.448991:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998743548e00) 00010000:00010000:2.0:1788625203.448994:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625203.448998:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6400, rc 0) 00000100:00100000:2.0:1788625203.449076:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:10503:x1875509185106048:12345-192.168.204.14@tcp:101:chmod.0 Request processed in 418us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625203.449082:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:2.0:1788625203.456843:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625203.456951:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185106304 00000100:00100000:1.0:1788625203.456961:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185106304 00000100:00100000:1.0:1788625203.457025:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:1.0:1788625203.457036:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:10503:x1875509185106304:12345-192.168.204.14@tcp:36:chmod.0 00010000:00010000:1.0:1788625203.457092:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625203.457125:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a45c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e021 expref: 8 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.457148:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998743548e00) 00010000:00010000:1.0:1788625203.457161:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625203.457189:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a463 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.457203:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a463 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.457214:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a463 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625203.457439:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e02820b7 reply state 00000000e0247f3f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a463 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.457452:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a463 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.457459:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:1.0:1788625203.457468:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788625203.457471:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788625203.457479:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788625203.457603:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:10503:x1875509185106304:12345-192.168.204.14@tcp:36:chmod.0 Request processed in 568us (767us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788625203.457611:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:3.0:1788625203.467882:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206163328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625203.467931:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625203.467956:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206163456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625203.467995:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625203.468333:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206163328 00000100:00100000:3.0:1788625203.468344:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206163328 00000100:00100000:3.0:1788625203.468413:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788625203.468424:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206163328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788625203.468462:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788625203.468639:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206163328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 214us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625203.468649:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788625203.468659:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625203.468681:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206163584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625203.468729:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206163328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625203.468741:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625203.471679:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625203.471820:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206163584 00000100:00100000:3.0:1788625203.471831:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206163584 00000100:00100000:3.0:1788625203.471889:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206163456 00000100:00100000:3.0:1788625203.471893:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206163456 00000100:00100000:3.0:1788625203.471909:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788625203.471919:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206163584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788625203.471952:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625203.472037:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206163584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (3298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625203.472044:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788625203.472062:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788625203.472068:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206163456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788625203.472078:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625203.472100:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206163456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625203.472105:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1788625203.482083:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887cb13800 x1875509206163584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625203.482111:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206163584:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788625203.490129:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9988449ace00 x1875509206163456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625203.490161:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206163456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625203.499511:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625203.499720:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185106432 00000100:00100000:0.0:1788625203.499730:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185106432 00000100:00100000:0.0:1788625203.499793:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 26 00000100:00100000:0.0:1788625203.499803:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:10504:x1875509185106432:12345-192.168.204.14@tcp:101:chown.0 00010000:00010000:0.0:1788625203.499828:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625203.499850:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a46a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e028 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.499939:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a471 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.499954:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.499968:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625203.500010:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788625203.500014:0:11318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625203.500051:0:11318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.500077:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a46a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e028 expref: 11 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.500093:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a471 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e028 expref: 10 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.500100:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:0.0:1788625203.500102:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625203.500107:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995000, rc 0) 00000100:00100000:0.0:1788625203.503868:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:10504:x1875509185106432:12345-192.168.204.14@tcp:101:chown.0 Request processed in 4052us (4356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625203.503882:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 26 00000100:00100000:3.0:1788625203.509099:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625203.509781:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185106560 00000100:00100000:1.0:1788625203.509798:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185106560 00000100:00100000:1.0:1788625203.509887:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 27 00000100:00100000:1.0:1788625203.509899:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:10504:x1875509185106560:12345-192.168.204.14@tcp:101:chown.0 00010000:00010000:1.0:1788625203.509924:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625203.509947:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882044000/0x2d2e3b3f34a7a478 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e02f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510015:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a47f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510030:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a47f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510041:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a47f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510052:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a486 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510060:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510067:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510162:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a48d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510171:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a48d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510178:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a48d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625203.510221:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788625203.510225:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625203.510245:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a48d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510258:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a47f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510265:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a47f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510272:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a47f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510279:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840031800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625203.510284:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a47f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510292:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a47f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510303:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:1.0:1788625203.510312:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625203.510318:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a47f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510326:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a47f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510341:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510348:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a486 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510354:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a486 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510359:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840030e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625203.510361:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a486 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510366:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a486 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510374:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9988749c3a00) 00010000:00010000:1.0:1788625203.510376:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625203.510379:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a486 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510384:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a486 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510422:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882044000/0x2d2e3b3f34a7a478 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e02f expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510450:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a48d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e02f expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.510458:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9988749c3b00) 00010000:00010000:1.0:1788625203.510460:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625203.510463:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998840030600, rc 0) 00000100:00100000:1.0:1788625203.511848:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:10504:x1875509185106560:12345-192.168.204.14@tcp:101:chown.0 Request processed in 1941us (2753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625203.511861:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 27 00000100:00100000:1.0:1788625203.526481:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625203.526623:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185106688 00000100:00100000:0.0:1788625203.526633:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185106688 00000100:00100000:0.0:1788625203.526717:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:0.0:1788625203.526727:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:10504:x1875509185106688:12345-192.168.204.14@tcp:900:chown.0 00000100:00100000:0.0:1788625203.526814:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:10504:x1875509185106688:12345-192.168.204.14@tcp:900:chown.0 Request processed in 87us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625203.526822:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:3.0:1788625203.533577:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625203.533746:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185106944 00000100:00100000:2.0:1788625203.533764:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185106944 00000100:00100000:2.0:1788625203.533852:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 28 00000100:00100000:2.0:1788625203.533863:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:10504:x1875509185106944:12345-192.168.204.14@tcp:36:chown.0 00010000:00010000:2.0:1788625203.533922:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625203.533950:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a48d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e02f expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.533972:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9988749c3b00) 00010000:00010000:2.0:1788625203.533977:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625203.534015:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a494 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.534031:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a494 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.534042:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a494 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788625203.542831:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1788625203.543001:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a447 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543016:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a447 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543026:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a447 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543032:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625203.543037:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a447 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543047:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a447 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543068:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9988749c3a00) 00010000:00010000:0.0:1788625203.543072:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625203.543080:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a447 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543087:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a447 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543110:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a44e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543310:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a44e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543317:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a44e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543321:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625203.543325:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a44e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543331:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a44e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543340:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9988749c3b00) 00010000:00010000:0.0:1788625203.543342:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625203.543345:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a44e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543351:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a44e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543364:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a463 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543371:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a463 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543376:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a463 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543381:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882045e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625203.543401:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a463 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543407:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a463 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543416:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:0.0:1788625203.543419:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788625203.543421:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a463 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.543427:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a463 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625203.545105:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b69b97a reply state 0000000013f5f77f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a494 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.545131:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a494 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.545141:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9988749c3b00) 00010000:00010000:1.0:1788625203.545144:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788625203.545148:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788625203.545160:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1788625203.545268:0:6513:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788625203.545293:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:10504:x1875509185106944:12345-192.168.204.14@tcp:36:chown.0 Request processed in 11428us (11771us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788625203.545302:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 28 00010000:00010000:0.0:1788625203.545480:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a494 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.545490:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a494 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.545498:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a494 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.545504:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625203.545508:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a494 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.545544:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a494 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.545555:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9988749c3b00) 00010000:00010000:0.0:1788625203.545557:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788625203.545573:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a494 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.545579:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a494 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625203.584206:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625203.584309:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185107072 00000100:00100000:0.0:1788625203.584321:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185107072 00000100:00100000:0.0:1788625203.584396:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 29 00000100:00100000:0.0:1788625203.584408:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:10505:x1875509185107072:12345-192.168.204.14@tcp:101:touch.500 00010000:00010000:0.0:1788625203.584434:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625203.584459:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a49b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e036 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788625203.588051:0:11318:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3490us 00010000:00010000:1.0:1788625203.617864:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.617906:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.617919:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.617936:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a4a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.617943:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.617950:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618077:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998840030a00/0x2d2e3b3f34a7a4b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618084:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998840030a00/0x2d2e3b3f34a7a4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618091:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998840030a00/0x2d2e3b3f34a7a4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625203.618117:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788625203.618121:0:11318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625203.618160:0:11318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998840030a00/0x2d2e3b3f34a7a4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618172:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618186:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618192:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618198:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840031800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625203.618202:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618208:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618220:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:1.0:1788625203.618223:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625203.618227:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618234:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618249:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618255:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a4a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618261:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a4a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618266:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840031200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625203.618275:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a4a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618280:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a4a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618287:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9987410b7700) 00010000:00010000:1.0:1788625203.618290:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625203.618292:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a4a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618297:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a4a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618334:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a49b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e036 expref: 8 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618349:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998840030a00/0x2d2e3b3f34a7a4b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e036 expref: 7 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.618357:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9987410b7a00) 00010000:00010000:1.0:1788625203.618359:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788625203.618362:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998840030a00, rc 0) 00000100:00100000:1.0:1788625203.618666:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:10505:x1875509185107072:12345-192.168.204.14@tcp:101:touch.500 Request processed in 34045us (34256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625203.618675:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 29 00000100:00100000:3.0:1788625203.633189:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625203.633299:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185107328 00000100:00100000:0.0:1788625203.633311:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185107328 00000100:00100000:0.0:1788625203.633395:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 30 00000100:00100000:0.0:1788625203.633406:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:10505:x1875509185107328:12345-192.168.204.14@tcp:101:touch.500 00010000:00010000:0.0:1788625203.633795:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625203.633818:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a4b7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e03d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.633946:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a4be lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.633962:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a4be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.633974:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a4be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.634113:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a4c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.634125:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a4c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.634133:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a4c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788625203.635121:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788625203.635282:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a4cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.635294:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a4cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.635303:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a4cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.635338:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a4be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.635356:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a4be lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.635363:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a4be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.635368:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625203.635372:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a4be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.635402:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a4be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.636269:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9987410b7a00) 00010000:00010000:0.0:1788625203.636275:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625203.636280:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a4be lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.636288:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a4be lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625203.636301:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cc260e8 reply state 000000006e3040ac transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a4c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.636313:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a4c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.636319:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff9988749c3b00) 00010000:00010000:0.0:1788625203.636322:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788625203.636325:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788625203.636366:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a4b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e03d expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.636380:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a4cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e03d expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.636764:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9988749c3a00) 00010000:00010000:0.0:1788625203.636767:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625203.636769:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994600, rc 0) 00000100:00100000:0.0:1788625203.636930:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:10505:x1875509185107328:12345-192.168.204.14@tcp:101:touch.500 Request processed in 3524us (3749us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788625203.636952:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 30 00000100:00100000:2.0:1788625203.642917:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625203.642982:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185107584 00000100:00100000:1.0:1788625203.642992:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185107584 00000100:00100000:1.0:1788625203.643060:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 31 00000100:00100000:1.0:1788625203.643070:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:10505:x1875509185107584:12345-192.168.204.14@tcp:36:touch.500 00010000:00010000:1.0:1788625203.643144:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625203.643174:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a4cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e03d expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.643200:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9988749c3a00) 00010000:00010000:1.0:1788625203.643211:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625203.643263:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.643278:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.643289:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625203.643403:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062bbd86b reply state 000000008f96255b transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.643416:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.643422:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9987410b7700) 00010000:00010000:1.0:1788625203.643424:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788625203.643426:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625203.643514:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:10505:x1875509185107584:12345-192.168.204.14@tcp:36:touch.500 Request processed in 445us (606us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788625203.643548:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 31 00000100:00100000:1.0:1788625203.646817:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625203.646912:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185107712 00000100:00100000:0.0:1788625203.646923:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185107712 00000100:00100000:0.0:1788625203.647009:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 32 00000100:00100000:0.0:1788625203.647020:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:10505:x1875509185107712:12345-192.168.204.14@tcp:101:touch.500 00010000:00010000:0.0:1788625203.647045:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625203.647067:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a4e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e044 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.647134:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a4e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e044 expref: 12 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.647150:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a4e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e044 expref: 12 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.647169:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9987410b7700) 00010000:00010000:0.0:1788625203.647172:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625203.647176:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995c00, rc 0) 00000100:00100000:0.0:1788625203.647235:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+12:10505:x1875509185107712:12345-192.168.204.14@tcp:101:touch.500 Request processed in 218us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625203.647242:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 32 00000100:00100000:3.0:1788625203.651109:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625203.651253:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185107840 00000100:00100000:2.0:1788625203.651264:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185107840 00000100:00100000:2.0:1788625203.651315:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:2.0:1788625203.651323:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875509185107840:12345-192.168.204.14@tcp:8:touch.500 00010000:00080000:2.0:1788625203.651360:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp t0 exp 0000000000000000 cur 324 last 0 00000020:00000080:2.0:1788625203.651413:0:8425:0:(genops.c:1385:class_connect()) connect: client 1338b3dc-3f02-4b26-a9aa-7a14f6033224, cookie 0x2d2e3b3f34a7a4e8 00002000:00100000:2.0:1788625203.651426:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1338b3dc-3f02-4b26-a9aa-7a14f6033224/ffff99887f8e7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788625203.651440:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788625203.651568:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788625203.651597:0:8425:0:(import.c:65:import_set_state_nolock()) ffff99887f8e6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625203.651659:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2390:x1875509185107840:12345-192.168.204.14@tcp:8:touch.500 Request processed in 335us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625203.651667:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:2.0:1788625203.654735:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625203.654813:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185107968 00000100:00100000:3.0:1788625203.654823:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185107968 00000100:00100000:3.0:1788625203.654900:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:3.0:1788625203.654911:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:0:x1875509185107968:12345-192.168.204.14@tcp:2:touch.500 00000100:00080000:2.0:1788625203.655217:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788625203.662058:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1788625203.662072:0:9503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000100:00100000:3.0:1788625203.662313:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:0:x1875509185107968:12345-192.168.204.14@tcp:2:touch.500 Request processed in 7397us (7578us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788625203.662327:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:3.0:1788625203.666324:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625203.667948:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185108224 00000100:00100000:1.0:1788625203.667967:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185108224 00000100:00100000:1.0:1788625203.668066:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 2 00000100:00100000:1.0:1788625203.668079:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+12:10505:x1875509185108224:12345-192.168.204.14@tcp:35:touch.500 00000100:00100000:1.0:1788625203.668437:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+13:10505:x1875509185108224:12345-192.168.204.14@tcp:35:touch.500 Request processed in 359us (2121us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788625203.668446:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 2 00000100:00100000:1.0:1788625203.680880:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625203.680961:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185108352 00000100:00100000:0.0:1788625203.680970:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185108352 00000100:00100000:0.0:1788625203.681054:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 33 00000100:00100000:0.0:1788625203.681065:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+13:10506:x1875509185108352:12345-192.168.204.14@tcp:101:rm.0 00010000:00010000:0.0:1788625203.681101:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625203.681143:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a4ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e04b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.681213:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a4f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.681231:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.681257:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625203.681303:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788625203.681306:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625203.681343:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.681370:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a4ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e04b expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.681400:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a4f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e04b expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.681410:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9987410b7a00) 00010000:00010000:0.0:1788625203.681413:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625203.681417:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994600, rc 0) 00000100:00100000:0.0:1788625203.681488:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:10506:x1875509185108352:12345-192.168.204.14@tcp:101:rm.0 Request processed in 425us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625203.681496:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 33 00000100:00100000:2.0:1788625203.688569:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625203.688719:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185108608 00000100:00100000:1.0:1788625203.688730:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185108608 00000100:00100000:1.0:1788625203.688791:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 34 00000100:00100000:1.0:1788625203.688802:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:10506:x1875509185108608:12345-192.168.204.14@tcp:101:rm.0 00010000:00010000:1.0:1788625203.688825:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625203.688851:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a4fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e052 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625203.688948:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788625203.689093:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a4fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e052 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.689107:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:1.0:1788625203.689110:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625203.689117:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a4fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e052 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.689131:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998840030600, rc 0) 00000100:00100000:1.0:1788625203.689197:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+15:10506:x1875509185108608:12345-192.168.204.14@tcp:101:rm.0 Request processed in 396us (693us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1788625203.689204:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 34 00000100:00100000:3.0:1788625203.699569:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625203.699938:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185108736 00000100:00100000:0.0:1788625203.699955:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185108736 00000100:00100000:0.0:1788625203.700020:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:0.0:1788625203.700031:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+15:10506:x1875509185108736:12345-192.168.204.14@tcp:37:rm.0 00000100:00100000:0.0:1788625203.706436:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+15:10506:x1875509185108736:12345-192.168.204.14@tcp:37:rm.0 Request processed in 6395us (6908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625203.706451:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:2.0:1788625203.724913:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625203.726320:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185108992 00000100:00100000:1.0:1788625203.726338:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185108992 00000100:00100000:1.0:1788625203.726429:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 4 00000100:00100000:1.0:1788625203.726441:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844c51050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+15:10506:x1875509185108992:12345-192.168.204.14@tcp:35:rm.0 00000100:00100000:1.0:1788625203.726718:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844c51050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:10506:x1875509185108992:12345-192.168.204.14@tcp:35:rm.0 Request processed in 279us (1883us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788625203.726726:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 4 00000100:00100000:3.0:1788625203.733441:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625203.733572:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185109248 00000100:00100000:0.0:1788625203.733583:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185109248 00000100:00100000:0.0:1788625203.733654:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 35 00000100:00100000:0.0:1788625203.733664:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:10506:x1875509185109248:12345-192.168.204.14@tcp:101:rm.0 00010000:00010000:0.0:1788625203.733694:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625203.733714:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a50b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e059 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.733830:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a512 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.733846:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a512 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.733859:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a512 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625203.733870:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788625203.733985:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a50b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e059 expref: 19 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.734005:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a512 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e059 expref: 18 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625203.734035:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9987410b7a00) 00010000:00010000:0.0:1788625203.734038:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788625203.734042:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882171200, rc 0) 00000100:00100000:0.0:1788625203.734127:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:10506:x1875509185109248:12345-192.168.204.14@tcp:101:rm.0 Request processed in 464us (836us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788625203.734135:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 35 00000100:00100000:3.0:1788625203.750776:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625203.751425:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185109376 00000100:00100000:0.0:1788625203.751436:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185109376 00000100:00100000:0.0:1788625203.751500:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 36 00000100:00100000:0.0:1788625203.751510:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:10506:x1875509185109376:12345-192.168.204.14@tcp:41:rm.0 00000004:00000024:0.0:1788625203.751609:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788625203.751686:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:10506:x1875509185109376:12345-192.168.204.14@tcp:41:rm.0 Request processed in 177us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625203.751694:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 36 00000100:00100000:3.0:1788625203.765568:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625203.765817:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185109504 00000100:00100000:2.0:1788625203.765829:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185109504 00000100:00100000:2.0:1788625203.765903:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 37 00000100:00100000:2.0:1788625203.765913:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:10506:x1875509185109504:12345-192.168.204.14@tcp:101:rm.0 00010000:00010000:2.0:1788625203.765933:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625203.765955:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a520 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e060 expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766022:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a527 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766037:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a527 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766048:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a527 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766057:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a52e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766063:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a52e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766069:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a52e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766431:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a535 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766441:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a535 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766542:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a535 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625203.766581:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788625203.766586:0:9824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625203.766608:0:9824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a535 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766621:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a535 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766629:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a527 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766636:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a527 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766642:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a527 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766648:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625203.766652:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a527 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766661:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a527 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766673:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9987410b7a00) 00010000:00010000:2.0:1788625203.766677:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625203.766681:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a527 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766697:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a527 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766710:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a52e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766717:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a52e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766722:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a52e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766726:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625203.766729:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a52e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766734:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a52e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766742:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff9988749c3b00) 00010000:00010000:2.0:1788625203.766744:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625203.766747:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a52e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766752:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a52e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766778:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a520 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e060 expref: 20 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766790:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a535 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e060 expref: 19 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.766804:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625203.766806:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625203.766809:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7200, rc 0) 00000100:00100000:2.0:1788625203.768136:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:10506:x1875509185109504:12345-192.168.204.14@tcp:101:rm.0 Request processed in 2215us (2610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625203.768149:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 37 00000100:00100000:3.0:1788625203.782217:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625203.782313:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185109760 00000100:00100000:2.0:1788625203.782323:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185109760 00000100:00100000:2.0:1788625203.782395:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 38 00000100:00100000:2.0:1788625203.782405:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:10506:x1875509185109760:12345-192.168.204.14@tcp:36:rm.0 00010000:00010000:2.0:1788625203.782468:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788625203.782496:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a535 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e060 expref: 19 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.782541:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a4e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e044 expref: 18 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.782554:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625203.782564:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a4f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e04b expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.782574:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9987410b7a00) 00010000:00010000:2.0:1788625203.782577:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625203.782599:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a53c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.782633:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a53c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.782644:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a53c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.782656:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a543 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.782663:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a543 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.782669:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a543 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.782754:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a54a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.782763:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a54a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.782769:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a54a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625203.782992:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788625203.783002:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 324890483962ns, next at 325890482078ns, rc = 0 00010000:00010000:2.0:1788625203.783046:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a551 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783055:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a551 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783074:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a551 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783082:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a551 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783089:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a551 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783095:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a551 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783122:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625203.783139:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a54a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783146:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a54a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783152:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a54a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783158:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625203.783163:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a54a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783170:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a54a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783179:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625203.783182:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788625203.783192:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a54a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783199:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a54a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.783204:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625203.783210:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a551 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783212:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a53c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.783217:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625203.783219:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a53c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.783220:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a551 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783225:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a53c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.783227:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a551 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783229:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625203.783232:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a53c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.783236:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625203.783237:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a53c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.783238:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788625203.783241:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a551 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783244:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9987410b7a00) 00010000:00010000:2.0:1788625203.783246:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625203.783247:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a551 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783249:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a53c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783254:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a53c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.783257:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625203.783258:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625203.783260:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1788625203.783262:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dda2c6c3 reply state 00000000ab5191fe transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a543 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783283:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a543 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625203.783289:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff9988749c3b00) 00010000:00010000:2.0:1788625203.783291:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625203.783294:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625203.783375:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:10506:x1875509185109760:12345-192.168.204.14@tcp:36:rm.0 Request processed in 970us (1164us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788625203.783393:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 38 00000100:00100000:3.0:1788625203.794935:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625203.795035:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185110016 00000100:00100000:0.0:1788625203.795046:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185110016 00000100:00100000:0.0:1788625203.795110:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 5 00000100:00100000:0.0:1788625203.795121:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:10506:x1875509185110016:12345-192.168.204.14@tcp:35:rm.0 00000100:00100000:0.0:1788625203.795354:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:10506:x1875509185110016:12345-192.168.204.14@tcp:35:rm.0 Request processed in 233us (428us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788625203.795361:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 5 00000100:00100000:3.0:1788625203.804846:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625203.805107:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185110272 00000100:00100000:1.0:1788625203.805144:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185110272 00000100:00100000:1.0:1788625203.805211:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 39 00000100:00100000:1.0:1788625203.805222:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:10506:x1875509185110272:12345-192.168.204.14@tcp:36:rm.0 00010000:00010000:1.0:1788625203.805287:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788625203.805316:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a512 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e059 expref: 19 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805341:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998840030a00/0x2d2e3b3f34a7a4b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e036 expref: 18 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805353:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9987410b7a00) 00010000:00010000:1.0:1788625203.805369:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a471 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e028 expref: 17 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805377:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:1.0:1788625203.805392:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625203.805416:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a558 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805430:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a558 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805441:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a558 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805453:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a55f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805459:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a55f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805477:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a55f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805624:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a566 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805632:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a566 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805639:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a566 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625203.805852:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788625203.805867:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a566 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805874:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a566 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805880:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a566 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805885:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840031200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625203.805889:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a566 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805896:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a566 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805904:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9987410b7200) 00010000:00010000:1.0:1788625203.805907:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788625203.805917:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a566 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805923:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998840031200/0x2d2e3b3f34a7a566 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805942:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a558 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805949:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a558 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805954:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a558 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805959:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840030600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625203.805962:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a558 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805968:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a558 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805975:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9987410b7b00) 00010000:00010000:1.0:1788625203.805977:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625203.805980:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a558 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.805985:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998840030600/0x2d2e3b3f34a7a558 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625203.805996:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a36d5c2c reply state 00000000fbf043f0 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a55f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.806019:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a55f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625203.806025:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9987410b7300) 00010000:00010000:1.0:1788625203.806027:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788625203.806029:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625203.806104:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:10506:x1875509185110272:12345-192.168.204.14@tcp:36:rm.0 Request processed in 882us (1267us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788625203.806111:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 39 00010000:00010000:1.0:1788625204.299737:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625205.244821:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625205.244903:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625205.244935:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625205.244958:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625205.244985:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625205.244999:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185110400 00000100:00100000:0.0:1788625205.245010:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185110400 00000100:00100000:3.0:1788625205.245018:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625205.245048:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185110656 00000100:00100000:3.0:1788625205.245053:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185110656 00000100:00100000:0.0:1788625205.245074:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 335 00000100:00100000:0.0:1788625205.245086:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2391:x1875509185110400:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625205.245169:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2391:x1875509185110400:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 85us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625205.245176:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 335 00000100:00100000:2.0:1788625205.245273:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185110912 00000100:00100000:2.0:1788625205.245278:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185110912 00000100:00100000:2.0:1788625205.245299:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185110528 00000100:00100000:2.0:1788625205.245302:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185110528 00000100:00100000:2.0:1788625205.245313:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185111040 00000100:00100000:2.0:1788625205.245315:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185111040 00000100:00100000:2.0:1788625205.245327:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 204 00000100:00100000:2.0:1788625205.245334:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185110656:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625205.245373:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 205 00000100:00100000:2.0:1788625205.245381:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185110656:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 45us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625205.245388:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185110912:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625205.245394:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 204 00000100:00100000:2.0:1788625205.245413:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 206 00000100:00100000:2.0:1788625205.245420:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:2391:x1875509185110528:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625205.245449:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:2391:x1875509185110528:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 30us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625205.245455:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 206 00000100:00100000:2.0:1788625205.245468:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 207 00000100:00100000:2.0:1788625205.245481:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185111040:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625205.245499:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185110912:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 116us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625205.245509:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185111040:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 27us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625205.245510:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 205 00000100:00080000:3.0:1788625205.245561:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625205.245565:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625205.245993:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185110784 00000100:00100000:3.0:1788625205.245999:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185110784 00000100:00100000:3.0:1788625205.246053:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 79 00000100:00100000:3.0:1788625205.246061:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185110784:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625205.246217:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185110784:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 156us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625205.246235:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 79 00000100:00080000:0.0:1788625205.246394:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625205.246438:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 207 00010000:00010000:0.0:1788625205.323924:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625206.352780:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625207.056370:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206163712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625207.056456:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625207.062686:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206163712 00000100:00100000:0.0:1788625207.062705:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206163712 00000100:00100000:0.0:1788625207.062838:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788625207.062849:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206163712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625207.062891:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788625207.064795:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206163712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1936us (8326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625207.064808:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788625207.064959:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206163712:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788625207.374150:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625207.564554:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206163840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625207.564632:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625207.565151:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206163840 00000100:00100000:2.0:1788625207.565161:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206163840 00000100:00100000:2.0:1788625207.565241:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788625207.565252:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206163840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788625207.565287:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625207.565350:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206163840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625207.565358:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788625207.565431:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788625207.565466:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bf480 x1875509206163840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625207.565491:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206163840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625207.567299:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206163968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625207.567371:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625207.567607:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206163968 00000100:00100000:3.0:1788625207.567616:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206163968 00000100:00080000:1.0:1788625207.567719:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625207.567760:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788625207.567771:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206163968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788625207.567793:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625207.567934:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206163968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625207.567941:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1788625207.568070:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998741dc2300 x1875509206163968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625207.568294:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206163968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625208.077903:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998741dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206164096:0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.077979:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206164480:0@lo:400:kworker.0 00000100:00100000:3.0:1788625208.077984:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625208.078059:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206164096 00000100:00100000:1.0:1788625208.078067:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206164096 00000100:00100000:1.0:1788625208.078121:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788625208.078131:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206164096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625208.080738:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206164352:0@lo:400:kworker.0 00000100:00100000:3.0:1788625208.081412:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206164608:0@lo:400:kworker.0 00000100:00100000:3.0:1788625208.081451:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625208.081484:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206165120:0@lo:400:kworker.0 00000100:00100000:3.0:1788625208.081508:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625208.081549:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206165632:0@lo:400:kworker.0 00000100:00100000:3.0:1788625208.081570:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625208.081614:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206165120 00000100:00100000:3.0:1788625208.081644:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206165120 00000100:00100000:3.0:1788625208.081688:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206165632 00000100:00100000:3.0:1788625208.081691:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206165632 00000100:00100000:3.0:1788625208.081724:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788625208.081743:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206165120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.081766:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625208.081793:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206164992:0@lo:400:kworker.0 00000100:00100000:3.0:1788625208.081798:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206165120:12345-0@lo:400:kworker.0 Request processed in 57us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625208.081804:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788625208.081822:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788625208.081826:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625208.081828:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206165632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.081838:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206165504:0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.081858:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625208.081864:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206165632:12345-0@lo:400:kworker.0 Request processed in 36us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625208.081870:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788625208.081878:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206164992 00000100:00100000:3.0:1788625208.081881:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206164992 00000100:00100000:0.0:1788625208.081887:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206164224:0@lo:400:kworker.0 00000100:00100000:3.0:1788625208.081892:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206165504 00000100:00100000:3.0:1788625208.081894:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206165504 00000100:00100000:3.0:1788625208.081907:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788625208.081911:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625208.081912:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206164992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.081929:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206164736:0@lo:400:kworker.0 00000100:00100000:3.0:1788625208.081940:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206164992:12345-0@lo:400:kworker.0 Request processed in 29us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625208.081946:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788625208.081948:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625208.081957:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788625208.081962:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206165248:0@lo:400:kworker.0 00000100:00100000:3.0:1788625208.081963:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206165504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.081981:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625208.081988:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206165504:12345-0@lo:400:kworker.0 Request processed in 25us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625208.081993:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788625208.082011:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206164480 00000100:00100000:0.0:1788625208.082014:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206164480 00000100:00100000:0.0:1788625208.082037:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206164224 00010000:00080000:3.0:1788625208.082038:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4ddf80 x1875509206165120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625208.082039:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206164224 00000100:00100000:0.0:1788625208.082048:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206164736 00000100:00100000:0.0:1788625208.082050:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206164736 00000100:00100000:3.0:1788625208.082052:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206165120:0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.082061:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206165248 00010000:00080000:3.0:1788625208.082062:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743977b80 x1875509206165632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625208.082064:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206165248 00000100:00100000:3.0:1788625208.082071:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206165632:0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.082076:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788625208.082081:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206164480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.082110:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206164480:12345-0@lo:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625208.082115:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788625208.082125:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788625208.082131:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206164224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.082158:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206164224:12345-0@lo:400:kworker.0 Request processed in 27us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625208.082163:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788625208.082172:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788625208.082177:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206164736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.082201:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206164736:12345-0@lo:400:kworker.0 Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625208.082211:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788625208.082222:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788625208.082227:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206165248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.082253:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206165248:12345-0@lo:400:kworker.0 Request processed in 25us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625208.082259:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788625208.082286:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206164480:0@lo:400:kworker.0 00010000:00080000:0.0:1788625208.082295:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439ff800 x1875509206164992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625208.082317:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206164992:0@lo:400:kworker.0 00010000:00080000:0.0:1788625208.082327:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743974e00 x1875509206165504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625208.082335:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206165504:0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.082366:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206164224:0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.082375:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206164736:0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.082383:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206165248:0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.082671:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206164608 00000100:00100000:0.0:1788625208.082676:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206164608 00000100:00100000:0.0:1788625208.082703:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788625208.082709:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206164608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.082750:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206164608:12345-0@lo:400:kworker.0 Request processed in 41us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625208.082765:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788625208.082794:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206164608:0@lo:400:kworker.0 00000100:00080000:0.0:1788625208.085668:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788625208.085678:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625208.085682:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206164096:12345-0@lo:400:kworker.0 Request processed in 7547us (7692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625208.085697:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788625208.085714:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998741dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206164096:0@lo:400:kworker.0 00000100:00100000:2.0:1788625208.094656:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625208.094747:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206164864:0@lo:400:kworker.0 00000100:00100000:2.0:1788625208.094797:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625208.094830:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206165376:0@lo:400:kworker.0 00000100:00100000:1.0:1788625208.095004:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206164864 00000100:00100000:1.0:1788625208.095013:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206164864 00000100:00100000:1.0:1788625208.095088:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788625208.095099:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206164864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625208.095163:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206164864:12345-0@lo:400:kworker.0 Request processed in 67us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625208.095172:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:1.0:1788625208.095206:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788625208.095270:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788625208.095332:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439ff100 x1875509206164864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625208.095348:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206164864:0@lo:400:kworker.0 00000100:00100000:1.0:1788625208.095462:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206165376 00000100:00100000:1.0:1788625208.095468:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206165376 00000100:00100000:1.0:1788625208.095501:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788625208.095509:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206165376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625208.095563:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206165376:12345-0@lo:400:kworker.0 Request processed in 55us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625208.095569:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:1.0:1788625208.095586:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788625208.095660:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4dd180 x1875509206165376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625208.095669:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206165376:0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.100191:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206164352 00000100:00100000:0.0:1788625208.100215:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206164352 00000100:00100000:1.0:1788625208.106495:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788625208.106534:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206164352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625208.106947:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206164352:0@lo:400:kworker.0 00000100:00100000:1.0:1788625208.107006:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206164352:12345-0@lo:400:kworker.0 Request processed in 498us (12358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625208.107014:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000001:02000400:3.0:1788625208.109382:0:13674:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788625208.397146:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788625208.587718:0:10009:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329695197400ns, next at 330695195080ns, rc = 0 00000100:00100000:0.0:1788625208.587745:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625208.587764:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206165760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625208.587845:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625208.591003:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206165760 00000100:00100000:3.0:1788625208.591017:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206165760 00000100:00100000:0.0:1788625208.591026:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206165888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625208.591079:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788625208.591092:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998741dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206165760:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625208.591106:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788625208.591127:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625208.591188:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998741dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206165760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (3342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625208.591189:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206165888 00000100:00100000:0.0:1788625208.591194:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206165888 00000100:00100000:3.0:1788625208.591199:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788625208.591219:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788625208.591228:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206165888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788625208.591241:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625208.591274:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206165888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625208.591282:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788625208.591298:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206166016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625208.591337:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788625208.591341:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743687800 x1875509206165888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625208.591379:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206165888:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788625208.591394:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c5ce00 x1875509206165760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625208.591407:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206165760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625208.591445:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206166016 00000100:00100000:0.0:1788625208.591450:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206166016 00000100:00100000:0.0:1788625208.591476:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788625208.591483:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206166016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788625208.591507:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788625208.591570:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206166016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625208.591577:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788625208.591587:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206166016:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1788625209.337246:0:13722:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef1b6a100 20000000:00000080:1.0:1788625209.337266:0:13722:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9987437c6c00 uarg=0000000000000000 20000000:01000000:1.0:1788625209.337319:0:13722:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788625209.337325:0:13722:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788625209.337329:0:13722:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788625209.338145:0:13723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788625209.338297:0:13722:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788625209.342392:0:13722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788625209.342449:0:13722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788625209.342468:0:13722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788625209.342486:0:13722:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788625209.342508:0:13722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7a56d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.342559:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a3fa expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.342568:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a40f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a408 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.342574:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a41d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a416 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.342601:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887c994400/0x2d2e3b3f34a7a42b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a424 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.342610:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998882045800/0x2d2e3b3f34a7a432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e013 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.342617:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998882044800/0x2d2e3b3f34a7a439 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e01a expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.342625:0:13722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7a56d lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.342667:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998882044800/0x2d2e3b3f34a7a439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e01a expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.342682:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998882044800/0x2d2e3b3f34a7a439 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e01a expref: 12 pid: 6503 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625209.342698:0:13722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1875509206166144:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625209.342797:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998882045800/0x2d2e3b3f34a7a432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e013 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.342806:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998882045800/0x2d2e3b3f34a7a432 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e013 expref: 12 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625209.342814:0:13722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1875509206166272:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625209.342838:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887c994400/0x2d2e3b3f34a7a42b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a424 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.342856:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887c994400/0x2d2e3b3f34a7a42b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a424 expref: 23 pid: 6506 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625209.342865:0:13722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1875509206166400:0@lo:104: 00000100:00100000:0.0:1788625209.342919:0:13722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625209.342955:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a41d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a416 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.342963:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a41d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a416 expref: 23 pid: 6506 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625209.342971:0:13722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1875509206166528:0@lo:104: 00010000:00010000:0.0:1788625209.342991:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a40f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a408 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.342998:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a40f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a408 expref: 23 pid: 6503 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625209.343006:0:13722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1875509206166656:0@lo:104: 00010000:00010000:0.0:1788625209.343021:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7a3fa expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.343028:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a401 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a3fa expref: 23 pid: 6503 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625209.343035:0:13722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1875509206166784:0@lo:104: 00000100:00100000:0.0:1788625209.343046:0:13722:0:(client.c:2716:ptlrpc_set_wait()) set ffff998844e53600 going to sleep for 11 seconds 00000100:00100000:3.0:1788625209.343962:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788625209.343987:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625209.344016:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625209.344028:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625209.344037:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206166400 00000100:00100000:3.0:1788625209.344044:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206166400 00000100:00100000:3.0:1788625209.344078:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206166528 00000100:00100000:3.0:1788625209.344080:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206166528 00000100:00100000:3.0:1788625209.344095:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206166656 00000100:00100000:3.0:1788625209.344097:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206166656 00000100:00100000:3.0:1788625209.344104:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206166784 00000100:00100000:3.0:1788625209.344106:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206166784 00000100:00100000:3.0:1788625209.344116:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788625209.344123:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:13722:x1875509206166400:12345-0@lo:104: 00010000:00010000:3.0:1788625209.344139:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998882045a00/0x2d2e3b3f34a7a424 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344195:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625209.344200:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+6:13722:x1875509206166400:12345-0@lo:104: Request processed in 78us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625209.344206:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788625209.344241:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788625209.344246:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:13722:x1875509206166528:12345-0@lo:104: 00010000:00010000:3.0:1788625209.344254:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887b682000/0x2d2e3b3f34a7a416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a41d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344291:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788625209.344296:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+5:13722:x1875509206166528:12345-0@lo:104: Request processed in 50us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625209.344302:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788625209.344311:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788625209.344317:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:13722:x1875509206166656:12345-0@lo:104: 00010000:00010000:3.0:1788625209.344323:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a40f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344358:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788625209.344368:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+4:13722:x1875509206166656:12345-0@lo:104: Request processed in 51us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625209.344374:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788625209.344386:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788625209.344391:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:13722:x1875509206166784:12345-0@lo:104: 00010000:00010000:3.0:1788625209.344399:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a3fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344425:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788625209.344429:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+3:13722:x1875509206166784:12345-0@lo:104: Request processed in 39us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625209.344434:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1788625209.344451:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788625209.344457:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998882045a00/0x2d2e3b3f34a7a424 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344464:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882045a00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625209.344468:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998882045a00/0x2d2e3b3f34a7a424 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344477:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998882045a00/0x2d2e3b3f34a7a424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625209.344484:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998882045a00/0x2d2e3b3f34a7a424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625209.344491:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788625209.344553:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998882045a00/0x2d2e3b3f34a7a424 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344568:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625209.344587:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998882045a00/0x2d2e3b3f34a7a424 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344594:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998882045a00/0x2d2e3b3f34a7a424 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a42b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344609:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788625209.344611:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b682000/0x2d2e3b3f34a7a416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a41d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344617:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682000 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625209.344619:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b682000/0x2d2e3b3f34a7a416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a41d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344625:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b682000/0x2d2e3b3f34a7a416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a41d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625209.344630:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b682000/0x2d2e3b3f34a7a416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a41d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625209.344636:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788625209.344648:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b682000/0x2d2e3b3f34a7a416 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a41d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344653:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625209.344669:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b682000/0x2d2e3b3f34a7a416 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a41d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344675:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b682000/0x2d2e3b3f34a7a416 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a41d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344691:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625209.344695:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a40f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344700:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625209.344703:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a40f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344710:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a40f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625209.344716:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a40f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625209.344721:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788625209.344734:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a408 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a40f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344740:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625209.344746:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a408 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a40f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344753:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887cac6e00/0x2d2e3b3f34a7a408 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a40f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344762:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625209.344766:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a3fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7a401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344781:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683a00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625209.344784:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a3fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7a401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344790:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a3fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7a401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625209.344795:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a3fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7a401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625209.344800:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788625209.344812:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a3fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344818:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625209.344824:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a3fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344830:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a3fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7a401 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.344843:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625209.344845:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625209.344846:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625209.344862:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206166912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625209.344897:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625209.344925:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625209.344932:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206167296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625209.344962:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625209.344990:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206167040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625209.345011:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625209.345028:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625209.345032:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206167168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625209.345051:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625209.345081:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206166912 00000100:00100000:3.0:1788625209.345086:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206166912 00010000:00010000:3.0:1788625209.345105:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887c994400/0x2d2e3b3f34a7a42b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a424 expref: 24 pid: 6506 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625209.345126:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206167296 00000100:00100000:3.0:1788625209.345129:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206167296 00010000:00010000:3.0:1788625209.345138:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a401 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a3fa expref: 25 pid: 6503 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625209.345147:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206167040 00000100:00100000:3.0:1788625209.345149:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206167040 00010000:00010000:3.0:1788625209.345157:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a41d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a416 expref: 26 pid: 6506 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625209.345166:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206167168 00000100:00100000:3.0:1788625209.345168:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206167168 00010000:00010000:3.0:1788625209.345175:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a40f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a408 expref: 27 pid: 6503 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625209.345186:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788625209.345192:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6544f02a-cd81-4e03-84c5-408bee21ab7a+27:3636:x1875509206166912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625209.345202:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625209.345208:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887c994400/0x2d2e3b3f34a7a42b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a424 expref: 27 pid: 6506 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.345223:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887c994400/0x2d2e3b3f34a7a42b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a424 expref: 27 pid: 6506 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.345239:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625209.345270:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6544f02a-cd81-4e03-84c5-408bee21ab7a+27:3636:x1875509206166912:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625209.345289:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788625209.345305:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788625209.345311:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6544f02a-cd81-4e03-84c5-408bee21ab7a+26:3636:x1875509206167296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625209.345319:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625209.345323:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a401 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a3fa expref: 26 pid: 6503 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.345332:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a401 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a3fa expref: 26 pid: 6503 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.345341:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625209.345363:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6544f02a-cd81-4e03-84c5-408bee21ab7a+26:3636:x1875509206167296:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625209.345369:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788625209.345381:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788625209.345387:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6544f02a-cd81-4e03-84c5-408bee21ab7a+25:3637:x1875509206167040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625209.345394:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625209.345399:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a41d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a416 expref: 25 pid: 6506 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.345406:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a41d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a416 expref: 25 pid: 6506 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.345422:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625209.345449:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6544f02a-cd81-4e03-84c5-408bee21ab7a+25:3637:x1875509206167040:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625209.345454:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788625209.345466:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788625209.345472:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3637:x1875509206167168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625209.345481:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625209.345484:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a40f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a408 expref: 24 pid: 6503 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.345493:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a40f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a408 expref: 24 pid: 6503 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.345502:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625209.345552:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3637:x1875509206167168:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625209.345558:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788625209.345602:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206167168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625209.345611:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206167040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625209.345635:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206167296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625209.345643:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206166912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625209.345933:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c994400/0x2d2e3b3f34a7a42b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a424 expref: 23 pid: 6506 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625209.345953:0:13722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1875509206166400:0@lo:104: 00010000:00010000:0.0:1788625209.345967:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac7800/0x2d2e3b3f34a7a41d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a416 expref: 22 pid: 6506 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625209.345975:0:13722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1875509206166528:0@lo:104: 00010000:00010000:0.0:1788625209.345983:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac6000/0x2d2e3b3f34a7a40f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a408 expref: 21 pid: 6503 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625209.345991:0:13722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1875509206166656:0@lo:104: 00010000:00010000:0.0:1788625209.346000:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac6a00/0x2d2e3b3f34a7a401 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7a3fa expref: 20 pid: 6503 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625209.346007:0:13722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1875509206166784:0@lo:104: 00010000:00010000:1.0:1788625209.346092:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625209.346098:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625209.352728:0:13722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1875509206166144:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625209.352747:0:13722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1875509206166272:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625209.352790:0:13722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7a56d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788625209.354794:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788625209.354833:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1788625209.354843:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788625209.354906:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a4c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.354931:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a4c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.354940:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a4c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.354946:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625209.354951:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a4c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.354959:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a4c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355055:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff9988749c3b00) 00010000:00010000:1.0:1788625209.355059:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625209.355065:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a4c5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355072:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a4c5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355096:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355102:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4da lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355109:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355114:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840031800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625209.355125:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355132:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4da lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355141:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9987410b7700) 00010000:00010000:1.0:1788625209.355144:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625209.355147:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4da lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355153:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998840031800/0x2d2e3b3f34a7a4da lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355174:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a543 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355180:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a543 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355186:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a543 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355192:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625209.355195:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a543 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355201:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a543 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355208:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff9988749c3b00) 00010000:00010000:1.0:1788625209.355211:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625209.355220:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a543 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355227:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a543 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355243:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a55f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355250:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a55f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355256:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a55f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355261:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840030e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625209.355264:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a55f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355281:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a55f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355290:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9987410b7300) 00010000:00010000:1.0:1788625209.355293:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625209.355296:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a55f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.355302:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998840030e00/0x2d2e3b3f34a7a55f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625209.355496:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206167424:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788625209.355599:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625209.355735:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206167424 00000100:00100000:3.0:1788625209.355745:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206167424 00000100:00100000:3.0:1788625209.355802:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788625209.355812:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206167424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788625209.355850:0:8868:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1788625209.355888:0:8868:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9c4132, atime: 0x6a9c4132, ctime: 0x6a9c4132, blocks: 0x0 00010000:00010000:3.0:1788625209.355895:0:8868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a574 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.355911:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1788625209.355915:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625209.355922:0:8868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.355937:0:8868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.355947:0:8868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.355955:0:8868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.356182:0:8868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788625209.356390:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1875509206167424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 578us (789us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788625209.356399:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1788625209.356500:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99887cb12680/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788625209.356507:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206167424:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788625209.356760:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625209.356768:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.356778:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625209.356783:0:10330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.356808:0:10330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.356827:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a574 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.356835:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a574 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.356854:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625209.356856:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625209.356858:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625209.360100:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625209.360148:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625209.360226:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185111168 00000100:00100000:3.0:1788625209.360249:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185111168 00010000:00010000:3.0:1788625209.360300:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998882044800/0x2d2e3b3f34a7a439 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e01a expref: 13 pid: 6503 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625209.360345:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185111296 00000100:00100000:3.0:1788625209.360349:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185111296 00010000:00010000:3.0:1788625209.360364:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998882045800/0x2d2e3b3f34a7a432 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e013 expref: 14 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625209.360490:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 50 00000100:00100000:3.0:1788625209.360502:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+14:2394:x1875509185111168:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625209.360542:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625209.360550:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998882044800/0x2d2e3b3f34a7a439 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e01a expref: 14 pid: 6503 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.360565:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998882044800/0x2d2e3b3f34a7a439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e01a expref: 14 pid: 6503 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.360584:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882044800/0x2d2e3b3f34a7a439 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e01a expref: 14 pid: 6503 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.360602:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625209.360670:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2394:x1875509185111168:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 159us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625209.360679:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 50 00000100:00100000:3.0:1788625209.360699:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 51 00000100:00100000:3.0:1788625209.360707:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:2394:x1875509185111296:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625209.360718:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625209.360723:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998882045800/0x2d2e3b3f34a7a432 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e013 expref: 12 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.360743:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998882045800/0x2d2e3b3f34a7a432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e013 expref: 12 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.360753:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882045800/0x2d2e3b3f34a7a432 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e013 expref: 12 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.360767:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7a56d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.360777:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7a56d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.360794:0:10331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7a56d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.360801:0:10331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7a56d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.360809:0:10331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7a56d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.360816:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7a56d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.360822:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625209.360826:0:10331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7a56d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.360835:0:10331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7a56d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.360861:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7a56d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625209.360872:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625209.360894:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:2394:x1875509185111296:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 187us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625209.360901:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 51 00010000:00010000:1.0:1788625209.361119:0:13722:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7a56d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.361138:0:13722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7a56d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625209.361146:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7a56d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625209.419693:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788625210.321989:0:13771:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc26a7c570 20000000:00000080:3.0:1788625210.322009:0:13771:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff998743a87000 uarg=0000000000000000 20000000:01000000:3.0:1788625210.322050:0:13771:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788625210.322057:0:13771:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788625210.322062:0:13771:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1788625210.322788:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1788625210.322959:0:13771:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1788625210.323047:0:13771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1788625210.323079:0:13771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1788625210.323093:0:13771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1788625210.323104:0:13771:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788625210.323124:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a57b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.323139:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a57b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.323150:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a57b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.323157:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a57b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.323164:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a57b lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.323179:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a57b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.323185:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625210.323190:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a57b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.323198:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a57b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.323211:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a57b lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.323220:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a57b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.323227:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a57b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625210.366585:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625210.366661:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625210.366685:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625210.366820:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625210.366840:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625210.366902:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185111552 00000100:00100000:3.0:1788625210.366914:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185111552 00000100:00100000:3.0:1788625210.366977:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185112064 00000100:00100000:3.0:1788625210.366980:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185112064 00000100:00100000:3.0:1788625210.367006:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 214 00000100:00100000:3.0:1788625210.367017:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185111552:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625210.367102:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185111552:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 87us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625210.367110:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 214 00000100:00100000:3.0:1788625210.367129:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 215 00000100:00100000:3.0:1788625210.367142:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185112064:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625210.367171:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185112064:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 30us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625210.367178:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 215 00000100:00080000:3.0:1788625210.367197:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625210.367201:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625210.367756:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625210.367780:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185111808 00000100:00100000:2.0:1788625210.367784:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185111808 00000100:00100000:2.0:1788625210.367823:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 84 00000100:00100000:2.0:1788625210.367830:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185111808:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625210.367865:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185111808:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 35us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625210.367872:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 84 00000100:00100000:2.0:1788625210.367892:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185111424 00000100:00100000:2.0:1788625210.367896:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185111424 00000100:00100000:2.0:1788625210.367922:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 337 00000100:00100000:2.0:1788625210.367929:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:2393:x1875509185111424:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625210.367953:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:2393:x1875509185111424:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 24us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625210.367960:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 337 00000100:00100000:3.0:1788625210.368048:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185111680 00000100:00100000:3.0:1788625210.368053:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185111680 00000100:00100000:3.0:1788625210.368087:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185111936 00000100:00100000:3.0:1788625210.368090:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185111936 00000100:00100000:3.0:1788625210.368111:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 216 00000100:00100000:3.0:1788625210.368118:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185111680:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625210.368161:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185111680:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 43us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625210.368169:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 216 00000100:00100000:3.0:1788625210.368182:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 217 00000100:00100000:3.0:1788625210.368189:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185111936:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625210.368213:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185111936:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 25us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625210.368219:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 217 00000100:00080000:3.0:1788625210.368338:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625210.368342:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625210.368346:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788625210.444799:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788625210.507643:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788625210.507654:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9988449c9000 from 7 10000000:01000000:3.0:1788625210.507659:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625210.507733:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.507763:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.507775:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625210.507802:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206167552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625210.507874:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625210.507949:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438ff780 going to sleep for 11 seconds 00000100:00100000:1.0:1788625210.508281:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206167552 00000100:00100000:1.0:1788625210.508290:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206167552 00000100:00100000:1.0:1788625210.508354:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788625210.508363:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:6508:x1875509206167552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625210.508378:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625210.508395:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998840031200/0x2d2e3b3f34a7a589 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a582 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.508419:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998840031200/0x2d2e3b3f34a7a589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a582 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.509044:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998840031200/0x2d2e3b3f34a7a589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a582 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.509063:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998840031200, rc 0) 00000100:00100000:1.0:1788625210.509142:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206167552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 778us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625210.509149:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788625210.509257:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206167552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625210.510908:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.510933:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625210.511035:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206167680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625210.511098:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625210.511152:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438ff780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625210.511351:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206167680 00000100:00100000:2.0:1788625210.511375:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206167680 00000100:00100000:2.0:1788625210.511441:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788625210.511451:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206167680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625210.511618:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206167680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625210.511627:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788625210.511662:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206167680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625210.511701:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206167808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625210.511745:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625210.511779:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438ff780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625210.511833:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206167808 00000100:00100000:0.0:1788625210.511839:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206167808 00000100:00100000:0.0:1788625210.511873:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788625210.511881:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206167808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625210.511970:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206167808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625210.511977:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788625210.512024:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206167808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625210.512396:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13784:1875509206167936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625210.512437:0:13784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625210.512491:0:13784:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438ff600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625210.512785:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206167936 00000100:00100000:1.0:1788625210.512790:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206167936 00000100:00100000:1.0:1788625210.512824:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788625210.512838:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:13784:x1875509206167936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625210.513608:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:13784:x1875509206167936:12345-0@lo:502:llog_process_th.0 Request processed in 770us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625210.513616:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788625210.513737:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13784:1875509206167936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788625210.513764:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625210.513774:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625210.513776:0:13784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788625210.513790:0:13784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9988449c9000 00000020:00000080:3.0:1788625210.513792:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625210.513897:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625210.513901:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625210.513903:0:13784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788625210.513907:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625210.513909:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625210.513910:0:13784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788625210.513914:0:13784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9988449c9000 00000020:00000080:3.0:1788625210.513916:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788625210.514278:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13784:1875509206168064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625210.514323:0:13784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625210.514366:0:13784:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438ff600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625210.514372:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206168064 00000100:00100000:1.0:1788625210.514382:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206168064 00000100:00100000:1.0:1788625210.514416:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788625210.514424:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:13784:x1875509206168064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625210.514509:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:13784:x1875509206168064:12345-0@lo:502:llog_process_th.0 Request processed in 85us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625210.514533:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788625210.514565:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13784:1875509206168064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788625210.514948:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625210.514953:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625210.514955:0:13784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788625210.514961:0:13784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788625210.515121:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788625210.515143:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625210.515155:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.515166:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625210.515176:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788625210.515179:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998878127800 from 7 10000000:01000000:1.0:1788625210.515181:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625210.515209:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.515217:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.515225:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625210.515258:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206168192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788625210.515290:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625210.515306:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c8c7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625210.515321:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206168192 00000100:00100000:1.0:1788625210.515325:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206168192 00000100:00100000:1.0:1788625210.515351:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788625210.515357:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:6508:x1875509206168192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625210.515366:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625210.515379:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998840030a00/0x2d2e3b3f34a7a597 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a590 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.515400:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998840030a00/0x2d2e3b3f34a7a597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a590 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.515411:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998840030a00/0x2d2e3b3f34a7a597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a590 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.515420:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998840030a00, rc 0) 00000100:00100000:1.0:1788625210.515448:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206168192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625210.515455:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788625210.515487:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206168192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625210.515500:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a597 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.515509:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a597 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625210.515670:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206168320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625210.515697:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625210.515719:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c8c7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625210.515731:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206168320 00000100:00100000:1.0:1788625210.515734:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206168320 00000100:00100000:1.0:1788625210.515765:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788625210.515772:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206168320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625210.515874:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206168320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625210.515880:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788625210.515907:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206168320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625210.515930:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206168448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625210.516676:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625210.516698:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c8c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625210.516760:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206168448 00000100:00100000:0.0:1788625210.516766:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206168448 00000100:00100000:0.0:1788625210.516803:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788625210.516810:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206168448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625210.516941:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206168448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625210.516956:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788625210.517027:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206168448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625210.517924:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743687800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13785:1875509206168576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625210.517970:0:13785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625210.518035:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff998844e539c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625210.518184:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206168576 00000100:00100000:3.0:1788625210.518190:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206168576 00000100:00100000:3.0:1788625210.518267:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788625210.518281:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:13785:x1875509206168576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625210.518407:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:13785:x1875509206168576:12345-0@lo:502:llog_process_th.0 Request processed in 127us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625210.518414:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788625210.518735:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743687800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13785:1875509206168576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788625210.518762:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625210.518772:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625210.518775:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788625210.518787:0:13785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998878127800 00000020:00000080:3.0:1788625210.518789:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625210.518840:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625210.518850:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625210.518851:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788625210.518855:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625210.518857:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625210.518858:0:13785:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788625210.518862:0:13785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998878127800 00000020:00000080:3.0:1788625210.518865:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788625210.518901:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13785:1875509206168704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625210.518937:0:13785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625210.518964:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206168704 00000100:00100000:3.0:1788625210.518969:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206168704 00000100:00100000:3.0:1788625210.518996:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788625210.519003:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:13785:x1875509206168704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625210.520330:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:13785:x1875509206168704:12345-0@lo:502:llog_process_th.0 Request processed in 1324us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625210.520341:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788625210.520462:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438ff180 going to sleep for 11 seconds 00000100:00100000:3.0:1788625210.520482:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13785:1875509206168704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788625210.520508:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625210.520531:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625210.520534:0:13785:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788625210.520544:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788625210.520748:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788625210.520772:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625210.520784:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a597 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.520796:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a597 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625210.520807:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788625210.520810:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99886c323000 from 7 10000000:01000000:1.0:1788625210.520813:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625210.520841:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.520856:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.520867:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625210.521513:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206168832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788625210.521655:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625210.521687:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c8c7000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625210.522239:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206168832 00000100:00100000:3.0:1788625210.522258:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206168832 00000100:00100000:3.0:1788625210.522309:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788625210.522318:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:6508:x1875509206168832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625210.522329:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625210.522344:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a5a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a59e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.522367:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a5a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a59e expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.522801:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a5a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a59e expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.522810:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682000, rc 0) 00000100:00100000:3.0:1788625210.522911:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206168832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 593us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625210.522918:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788625210.522991:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206168832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625210.523010:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a5a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625210.523020:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a5a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625210.523160:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206168960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625210.523191:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625210.523218:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c649c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625210.523233:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206168960 00000100:00100000:2.0:1788625210.523236:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206168960 00000100:00100000:2.0:1788625210.523845:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788625210.523854:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206168960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625210.524215:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206168960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 362us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625210.524223:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788625210.524298:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206168960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625210.524335:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206169088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625210.524377:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625210.524442:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c8c7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625210.524479:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206169088 00000100:00100000:2.0:1788625210.524484:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206169088 00000100:00100000:2.0:1788625210.524683:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788625210.524691:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206169088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625210.524815:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206169088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625210.524822:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788625210.524892:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206169088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625210.525352:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743687800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13788:1875509206169216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625210.525387:0:13788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625210.525418:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff998844e53180 going to sleep for 11 seconds 00000100:00100000:1.0:1788625210.525467:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206169216 00000100:00100000:1.0:1788625210.525472:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206169216 00000100:00100000:1.0:1788625210.525505:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788625210.525513:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:13788:x1875509206169216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625210.525627:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:13788:x1875509206169216:12345-0@lo:502:llog_process_th.0 Request processed in 114us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625210.525635:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788625210.525676:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743687800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13788:1875509206169216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625210.525697:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625210.525707:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625210.525710:0:13788:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788625210.525716:0:13788:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99886c323000 00000020:00000080:1.0:1788625210.525723:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788625210.525782:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625210.525787:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625210.525788:0:13788:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788625210.525790:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625210.525793:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625210.525794:0:13788:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788625210.525797:0:13788:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99886c323000 00000020:00000080:1.0:1788625210.525799:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788625210.525832:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13788:1875509206169344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625210.525864:0:13788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625210.525884:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206169344 00000100:00100000:1.0:1788625210.525888:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206169344 00000100:00100000:1.0:1788625210.525904:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788625210.525910:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:13788:x1875509206169344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625210.525984:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:13788:x1875509206169344:12345-0@lo:502:llog_process_th.0 Request processed in 73us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625210.526003:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788625210.526032:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c8c7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625210.526043:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13788:1875509206169344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625210.526059:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625210.526063:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625210.526064:0:13788:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788625210.526068:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788625210.526119:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788625210.526137:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625210.526147:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a5a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.526168:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a5a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625210.526179:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788625210.526181:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998852348000 from 7 10000000:01000000:1.0:1788625210.526184:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625210.526206:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.526214:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.526223:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625210.526235:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206169472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788625210.526272:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625210.526285:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c8c7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625210.526298:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206169472 00000100:00100000:1.0:1788625210.526301:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206169472 00000100:00100000:1.0:1788625210.526318:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788625210.526324:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:6508:x1875509206169472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625210.526332:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625210.526344:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998882045800/0x2d2e3b3f34a7a5b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7a5ac expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.526367:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998882045800/0x2d2e3b3f34a7a5b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a5ac expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.526388:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998882045800/0x2d2e3b3f34a7a5b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a5ac expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.526397:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882045800, rc 0) 00000100:00100000:1.0:1788625210.526425:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206169472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625210.526431:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788625210.526459:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206169472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625210.526471:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.526480:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625210.526541:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206169600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625210.526571:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625210.526585:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c8c7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625210.526597:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206169600 00000100:00100000:1.0:1788625210.526600:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206169600 00000100:00100000:1.0:1788625210.526615:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788625210.526620:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206169600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625210.526702:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206169600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625210.526709:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788625210.526739:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206169600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625210.526775:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206169728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625210.526806:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625210.526820:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c8c7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625210.526831:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206169728 00000100:00100000:1.0:1788625210.526834:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206169728 00000100:00100000:1.0:1788625210.526850:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788625210.526856:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206169728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625210.526919:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:6508:x1875509206169728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625210.526926:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788625210.526963:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6544f02a-cd81-4e03-84c5-408bee21ab7a:6508:1875509206169728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625210.528682:0:13789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13789:1875509206169856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625210.528747:0:13789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625210.528820:0:13789:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c64cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625210.528853:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206169856 00000100:00100000:1.0:1788625210.528859:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206169856 00000100:00100000:1.0:1788625210.529122:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788625210.529132:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:13789:x1875509206169856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625210.529245:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:13789:x1875509206169856:12345-0@lo:502:llog_process_th.0 Request processed in 115us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625210.529266:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788625210.529343:0:13789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13789:1875509206169856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788625210.529372:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625210.529381:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625210.529384:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788625210.529392:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998852348000 00000020:00000080:2.0:1788625210.529394:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788625210.529449:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625210.529668:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625210.529670:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788625210.529674:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625210.529679:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625210.529681:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788625210.529684:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998852348000 00000020:00000080:2.0:1788625210.529686:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788625210.529829:0:13789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13789:1875509206169984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625210.529875:0:13789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625210.530287:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206169984 00000100:00100000:0.0:1788625210.530294:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206169984 00000100:00100000:0.0:1788625210.530322:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788625210.530331:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:13789:x1875509206169984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625210.530418:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:13789:x1875509206169984:12345-0@lo:502:llog_process_th.0 Request processed in 88us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625210.530425:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788625210.530645:0:13789:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c64cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625210.530663:0:13789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6544f02a-cd81-4e03-84c5-408bee21ab7a:13789:1875509206169984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788625210.530684:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625210.530689:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625210.530691:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788625210.530699:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788625210.531063:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788625210.531085:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625210.531097:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625210.531109:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625210.538848:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788625210.572416:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788625210.684463:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625210.687220:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185112192 00000100:00100000:2.0:1788625210.687241:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185112192 00000100:00100000:3.0:1788625210.693232:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 358 00000100:00100000:3.0:1788625210.693260:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:6164:x1875509185112192:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625210.693279:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625210.693316:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b683800/0x2d2e3b3f34a7a5ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e067 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.693354:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b683800/0x2d2e3b3f34a7a5ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e067 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.693366:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b683800/0x2d2e3b3f34a7a5ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e067 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625210.693375:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683800, rc 0) 00000100:00100000:3.0:1788625210.693453:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:6164:x1875509185112192:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 Request processed in 197us (9000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625210.693461:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 358 00000100:00100000:3.0:1788625210.701829:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625210.701989:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185112320 00000100:00100000:0.0:1788625210.701999:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185112320 00000100:00100000:0.0:1788625210.702066:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 359 00000100:00100000:0.0:1788625210.702077:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:6164:x1875509185112320:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625210.702231:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:6164:x1875509185112320:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 Request processed in 156us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625210.702240:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 359 00000100:00100000:3.0:1788625210.706683:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625210.711577:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185112448 00000100:00100000:0.0:1788625210.711611:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185112448 00000100:00100000:2.0:1788625210.711748:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 360 00000100:00100000:2.0:1788625210.711758:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:6164:x1875509185112448:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625210.711915:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:6164:x1875509185112448:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 Request processed in 157us (5239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625210.711923:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 360 00000100:00100000:3.0:1788625210.720458:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625210.720653:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185112576 00000100:00100000:0.0:1788625210.720663:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185112576 00000100:00100000:0.0:1788625210.720723:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 361 00000100:00100000:0.0:1788625210.720734:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:10790:x1875509185112576:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625210.720878:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:10790:x1875509185112576:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 145us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625210.720886:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 361 00000100:00100000:3.0:1788625210.726645:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625210.726731:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185112704 00000100:00100000:2.0:1788625210.726743:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185112704 00000100:00100000:2.0:1788625210.726805:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 362 00000100:00100000:2.0:1788625210.726816:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:10790:x1875509185112704:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788625210.726966:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:10790:x1875509185112704:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 151us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625210.726975:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 362 00000100:00100000:3.0:1788625210.732990:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625210.733069:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185112832 00000100:00100000:0.0:1788625210.733079:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185112832 00000100:00100000:0.0:1788625210.733154:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 363 00000100:00100000:0.0:1788625210.733166:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:6164:x1875509185112832:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625210.733186:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625210.733207:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998882171a00/0x2d2e3b3f34a7a5c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e06e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625210.733239:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998882171a00/0x2d2e3b3f34a7a5c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e06e expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625210.733263:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998882171a00/0x2d2e3b3f34a7a5c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e06e expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625210.733274:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882171a00, rc 0) 00000100:00100000:0.0:1788625210.733331:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:6164:x1875509185112832:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 Request processed in 168us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625210.733338:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 363 00000100:00100000:3.0:1788625210.743495:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625210.744432:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185112960 00000100:00100000:2.0:1788625210.744445:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185112960 00000100:00100000:2.0:1788625210.744513:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 364 00000100:00100000:2.0:1788625210.744552:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:6164:x1875509185112960:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625210.744860:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:6164:x1875509185112960:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 Request processed in 310us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625210.744869:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 364 00000100:00100000:3.0:1788625210.746683:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625210.746828:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185113088 00000100:00100000:0.0:1788625210.746836:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185113088 00000100:00100000:0.0:1788625210.746908:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 365 00000100:00100000:0.0:1788625210.746917:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:6164:x1875509185113088:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625210.747046:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:6164:x1875509185113088:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 Request processed in 130us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625210.747054:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 365 00000100:00100000:3.0:1788625210.754550:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625210.756781:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185113216 00000100:00100000:2.0:1788625210.756797:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185113216 00000100:00100000:2.0:1788625210.756864:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 366 00000100:00100000:2.0:1788625210.756890:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:10793:x1875509185113216:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788625210.757238:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:10793:x1875509185113216:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 349us (2728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625210.757259:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 366 00000100:00100000:3.0:1788625210.764065:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625210.764132:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185113344 00000100:00100000:2.0:1788625210.764142:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185113344 00000100:00100000:2.0:1788625210.764203:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 367 00000100:00100000:2.0:1788625210.764213:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:10793:x1875509185113344:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788625210.772913:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:10793:x1875509185113344:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 8689us (8846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625210.772929:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 367 00010000:00010000:0.0:1788625211.467945:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625211.599074:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788625211.600539:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788625212.172252:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625212.172275:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206170112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625212.172346:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625212.172465:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206170112 00000100:00100000:1.0:1788625212.172474:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206170112 00000100:00100000:1.0:1788625212.172559:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788625212.172569:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206170112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788625212.172604:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788625212.172667:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206170112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625212.172674:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788625212.173825:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206170112:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788625212.492474:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625212.683877:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206170240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625212.684001:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625212.684218:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206170240 00000100:00100000:1.0:1788625212.684227:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206170240 00000100:00100000:1.0:1788625212.684297:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1788625212.684302:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625212.684309:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206170240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625212.684342:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625212.684404:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206170240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625212.684412:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:3.0:1788625212.685056:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743974e00 x1875509206170240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625212.685090:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206170240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625212.685349:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625212.685364:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206170368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625212.685416:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625212.685503:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206170368 00000100:00100000:0.0:1788625212.685510:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206170368 00000100:00100000:0.0:1788625212.685588:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788625212.685596:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206170368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625212.685612:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625212.685649:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206170368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625212.685655:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1788625212.685710:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788625212.685733:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bc380 x1875509206170368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625212.685746:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206170368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625213.196736:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625213.196767:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206170496:0@lo:400:kworker.0 00000100:00100000:0.0:1788625213.196767:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206170624:0@lo:400:kworker.0 00000100:00100000:3.0:1788625213.196992:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206171008:0@lo:400:kworker.0 00000100:00100000:2.0:1788625213.199630:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625213.199716:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206170880:0@lo:400:kworker.0 00000100:00100000:2.0:1788625213.199759:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625213.199788:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206171392:0@lo:400:kworker.0 00000100:00100000:2.0:1788625213.199813:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625213.199834:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206171904:0@lo:400:kworker.0 00000100:00100000:2.0:1788625213.199856:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625213.199901:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206170880 00000100:00100000:2.0:1788625213.199921:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206170880 00000100:00100000:2.0:1788625213.199995:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788625213.200003:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206170880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625213.200062:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206170880:12345-0@lo:400:kworker.0 Request processed in 60us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625213.200069:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788625213.200095:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206171392 00000100:00100000:2.0:1788625213.200099:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206171392 00000100:00100000:2.0:1788625213.200123:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206171904 00000100:00100000:2.0:1788625213.200126:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206171904 00000100:00100000:2.0:1788625213.200159:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788625213.200165:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206171392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625213.200205:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206171392:12345-0@lo:400:kworker.0 Request processed in 30us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625213.200211:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788625213.200231:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788625213.200238:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206171904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625213.200690:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206170496 00000100:00100000:1.0:1788625213.200696:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206170496 00000100:00100000:1.0:1788625213.200730:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788625213.200737:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206170496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625213.204963:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206170496:12345-0@lo:400:kworker.0 Request processed in 4216us (5329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625213.204982:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788625213.205152:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206170880:0@lo:400:kworker.0 00010000:00080000:1.0:1788625213.205170:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439ff800 x1875509206171392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625213.205210:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206171392:0@lo:400:kworker.0 00000100:00100000:1.0:1788625213.205238:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206171904:0@lo:400:kworker.0 00000100:00100000:1.0:1788625213.205248:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206170496:0@lo:400:kworker.0 00000100:00080000:1.0:1788625213.205304:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625213.205323:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206170752:0@lo:400:kworker.0 00000100:00100000:1.0:1788625213.205364:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625213.205396:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206171264:0@lo:400:kworker.0 00000100:00100000:1.0:1788625213.205421:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625213.205440:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206171776:0@lo:400:kworker.0 00000100:00100000:1.0:1788625213.205460:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625213.205482:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788625213.205488:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206171136:0@lo:400:kworker.0 00000100:00100000:1.0:1788625213.205510:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625213.205559:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206171648:0@lo:400:kworker.0 00000100:00100000:1.0:1788625213.205580:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625213.205610:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206171264 00000100:00100000:1.0:1788625213.205618:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206171264 00000100:00100000:1.0:1788625213.205664:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206171776 00000100:00100000:1.0:1788625213.205668:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206171776 00000100:00100000:1.0:1788625213.205683:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206171136 00000100:00100000:1.0:1788625213.205685:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206171136 00000100:00100000:3.0:1788625213.207325:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206171648 00000100:00100000:3.0:1788625213.207341:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206171648 00000100:00100000:1.0:1788625213.207596:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788625213.207609:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206171264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625213.207700:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206171264:12345-0@lo:400:kworker.0 Request processed in 95us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625213.207724:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788625213.207742:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788625213.207749:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206171776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625213.207784:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206171776:12345-0@lo:400:kworker.0 Request processed in 36us (2323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625213.207790:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788625213.207801:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788625213.207993:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788625213.208000:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206171648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625213.208041:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206171648:12345-0@lo:400:kworker.0 Request processed in 42us (2460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625213.208047:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788625213.208087:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625213.208125:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206171520:0@lo:400:kworker.0 00000100:00100000:3.0:1788625213.208153:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625213.208177:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206171520 00000100:00100000:3.0:1788625213.208181:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206171520 00000100:00100000:3.0:1788625213.208230:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788625213.208237:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206171520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625213.208283:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206171520:12345-0@lo:400:kworker.0 Request processed in 47us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625213.208288:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1788625213.208326:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439fd180 x1875509206171520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625213.208354:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206171520:0@lo:400:kworker.0 00000100:00100000:3.0:1788625213.208362:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206172032:0@lo:400:kworker.0 00000100:00100000:3.0:1788625213.208392:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625213.208411:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206172032 00000100:00100000:3.0:1788625213.208414:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206172032 00000100:00100000:3.0:1788625213.208438:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788625213.208443:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998874f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1875509206172032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625213.208470:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998874f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1875509206172032:12345-0@lo:400:kworker.0 Request processed in 27us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625213.208476:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788625213.208500:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206172032:0@lo:400:kworker.0 00000100:00080000:3.0:1788625213.208966:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625213.208972:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625213.208974:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625213.208986:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206170752 00000100:00100000:3.0:1788625213.208990:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206170752 00000100:00100000:3.0:1788625213.209013:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206171008 00000100:00100000:3.0:1788625213.209016:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206171008 00000100:00100000:3.0:1788625213.209028:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788625213.209035:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206170752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625213.209073:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206170752:12345-0@lo:400:kworker.0 Request processed in 39us (3709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625213.209079:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788625213.209090:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788625213.209096:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206171008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625213.209141:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206171008:12345-0@lo:400:kworker.0 Request processed in 45us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625213.209147:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788625213.209174:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206171008:0@lo:400:kworker.0 00000100:00100000:3.0:1788625213.209364:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206171648:0@lo:400:kworker.0 00000100:00100000:3.0:1788625213.209376:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206170752:0@lo:400:kworker.0 00010000:00080000:3.0:1788625213.209390:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439fd500 x1875509206171264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625213.209401:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206171264:0@lo:400:kworker.0 00010000:00080000:3.0:1788625213.209413:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743832300 x1875509206171776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625213.209422:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206171776:0@lo:400:kworker.0 00000100:00100000:2.0:1788625213.211747:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206171904:12345-0@lo:400:kworker.0 Request processed in 11500us (11880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625213.211764:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788625213.212103:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206171136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625213.212237:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206171136:12345-0@lo:400:kworker.0 Request processed in 4430us (6726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625213.212244:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788625213.213032:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206171136:0@lo:400:kworker.0 00000100:00100000:0.0:1788625213.214737:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625213.215044:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206170624 00000100:00100000:3.0:1788625213.215055:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206170624 00000100:00100000:3.0:1788625213.215119:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788625213.215130:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206170624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625213.215218:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206170624:12345-0@lo:400:kworker.0 Request processed in 91us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625213.215226:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788625213.215326:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206170624:0@lo:400:kworker.0 00010000:00010000:1.0:1788625213.515799:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625213.707717:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206172416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625213.707736:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206172288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625213.710461:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625213.710685:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206172416 00000100:00100000:0.0:1788625213.710766:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206172416 00000100:00100000:0.0:1788625213.711102:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788625213.711113:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206172416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788625213.711148:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625213.711232:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206172416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625213.711240:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788625213.711323:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206172416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625213.711404:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625213.711504:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206172160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625213.711569:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625213.711678:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206172288 00000100:00100000:3.0:1788625213.711684:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206172288 00000100:00100000:2.0:1788625213.711735:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206172160 00000100:00100000:2.0:1788625213.711741:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206172160 00000100:00100000:3.0:1788625213.711842:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788625213.711864:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875509206172288:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625213.711864:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788625213.711877:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206172160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788625213.711903:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788625213.711946:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206172160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625213.711961:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788625213.711994:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206172160:0@lo:41:osp-pre-0-1.0 00002000:00000024:3.0:1788625213.712089:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625213.712145:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875509206172288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 286us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625213.712154:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788625213.712175:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206172288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788625214.542254:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788625214.735751:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1788625215.484610:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625215.485065:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625215.485097:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625215.485131:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625215.485160:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625215.485189:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625215.485209:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185113856 00000100:00100000:0.0:1788625215.485220:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185113856 00000100:00100000:1.0:1788625215.485224:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185113600 00000100:00100000:1.0:1788625215.485230:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185113600 00000100:00100000:1.0:1788625215.485287:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185114112 00000100:00100000:1.0:1788625215.485292:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185114112 00000100:00100000:0.0:1788625215.485292:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 89 00000100:00100000:0.0:1788625215.485306:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185113856:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625215.485311:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185113728 00000100:00100000:1.0:1788625215.485326:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185113728 00000100:00100000:1.0:1788625215.485345:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185113984 00000100:00100000:1.0:1788625215.485348:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185113984 00000100:00100000:1.0:1788625215.485363:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 224 00000100:00100000:1.0:1788625215.485372:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185113600:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625215.485386:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185113856:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 82us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625215.485395:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 89 00000100:00100000:1.0:1788625215.485412:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185113600:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 39us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625215.485420:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 224 00000100:00100000:1.0:1788625215.485436:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 225 00000100:00100000:1.0:1788625215.485445:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185114112:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625215.485474:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185114112:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 31us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625215.485481:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 225 00000100:00100000:1.0:1788625215.485497:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 226 00000100:00100000:1.0:1788625215.485506:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185113728:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625215.485585:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185113728:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 81us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625215.485591:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 226 00000100:00100000:1.0:1788625215.485602:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 227 00000100:00100000:1.0:1788625215.485608:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185113984:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625215.485633:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185113984:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 25us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625215.485640:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 227 00000100:00100000:2.0:1788625215.485735:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185113472 00000100:00100000:2.0:1788625215.485740:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185113472 00000100:00100000:2.0:1788625215.485784:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 369 00000100:00100000:2.0:1788625215.485792:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2394:x1875509185113472:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625215.485832:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2394:x1875509185113472:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 41us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625215.485838:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 369 00000100:00080000:3.0:1788625215.486297:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625215.486302:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625215.486305:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788625215.563738:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625216.588176:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625217.291875:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206172544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625217.292081:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625217.292140:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206172544 00000100:00100000:3.0:1788625217.292149:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206172544 00000100:00100000:3.0:1788625217.292201:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788625217.292209:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206172544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788625217.292243:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788625217.292303:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206172544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625217.292310:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788625217.292372:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206172544:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788625217.611750:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625217.805377:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206172672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625217.805459:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625217.805618:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206172672 00000100:00100000:0.0:1788625217.805629:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206172672 00000100:00100000:0.0:1788625217.805701:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788625217.805711:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206172672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625217.805893:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625217.806000:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206172800:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788625217.806027:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625217.806038:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625217.806057:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206172800 00000100:00100000:1.0:1788625217.806064:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206172800 00000100:00100000:1.0:1788625217.806273:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788625217.806281:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206172800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625217.806294:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625217.806339:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206172800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625217.806346:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1788625217.806388:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439ff800 x1875509206172800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625217.806406:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206172800:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788625217.806457:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625217.808454:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206172672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2737us (2987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625217.808466:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:3.0:1788625217.811261:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8bdf80 x1875509206172672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625217.811290:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206172672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625218.316778:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206173056:0@lo:400:kworker.0 00000100:00100000:0.0:1788625218.316868:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625218.316936:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206173568:0@lo:400:kworker.0 00000100:00100000:0.0:1788625218.316959:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625218.316984:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206174080:0@lo:400:kworker.0 00000100:00100000:0.0:1788625218.317003:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625218.317024:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788625218.317030:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206173184:0@lo:400:kworker.0 00000100:00100000:0.0:1788625218.317055:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625218.317073:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206173696:0@lo:400:kworker.0 00000100:00100000:0.0:1788625218.317102:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625218.317116:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206174208:0@lo:400:kworker.0 00000100:00100000:0.0:1788625218.317134:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625218.317159:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206173056 00000100:00100000:0.0:1788625218.317166:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206173056 00000100:00100000:0.0:1788625218.317205:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206173568 00000100:00100000:0.0:1788625218.317208:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206173568 00000100:00100000:0.0:1788625218.317232:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206174080 00000100:00100000:0.0:1788625218.317235:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206174080 00000100:00100000:0.0:1788625218.317249:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206173696 00000100:00100000:0.0:1788625218.317251:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206173696 00000100:00100000:0.0:1788625218.317260:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206174208 00000100:00100000:0.0:1788625218.317262:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206174208 00000100:00100000:0.0:1788625218.317275:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788625218.317283:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206173056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625218.317331:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206173056:12345-0@lo:400:kworker.0 Request processed in 48us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625218.317343:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788625218.317368:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788625218.317374:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206173568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625218.317404:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206173568:12345-0@lo:400:kworker.0 Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625218.317410:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788625218.317419:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788625218.317425:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206174080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625218.317448:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206174080:12345-0@lo:400:kworker.0 Request processed in 24us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625218.317453:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788625218.317462:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788625218.317466:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206173696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625218.317488:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206173696:12345-0@lo:400:kworker.0 Request processed in 22us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625218.317493:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788625218.317501:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788625218.317506:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206174208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625218.317555:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206174208:12345-0@lo:400:kworker.0 Request processed in 49us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625218.317561:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00080000:0.0:1788625218.317575:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788625218.317578:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625218.317586:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206173184 00000100:00100000:0.0:1788625218.317589:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206173184 00000100:00100000:0.0:1788625218.317608:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788625218.317614:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206173184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625218.317653:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206173184:12345-0@lo:400:kworker.0 Request processed in 39us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625218.317658:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788625218.317692:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206173184:0@lo:400:kworker.0 00010000:00080000:0.0:1788625218.317706:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743975180 x1875509206173696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625218.317715:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206173696:0@lo:400:kworker.0 00010000:00080000:0.0:1788625218.317722:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743977b80 x1875509206174208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625218.317729:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206174208:0@lo:400:kworker.0 00000100:00100000:0.0:1788625218.317736:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206173056:0@lo:400:kworker.0 00000100:00100000:0.0:1788625218.317743:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206173568:0@lo:400:kworker.0 00000100:00100000:0.0:1788625218.317749:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206174080:0@lo:400:kworker.0 00000100:00100000:3.0:1788625218.317973:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206173312:0@lo:400:kworker.0 00000100:00100000:3.0:1788625218.318005:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625218.318044:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206173824:0@lo:400:kworker.0 00000100:00100000:3.0:1788625218.318069:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625218.318114:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206174336:0@lo:400:kworker.0 00000100:00100000:3.0:1788625218.318136:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625218.318163:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788625218.318171:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206172928:0@lo:400:kworker.0 00000100:00100000:3.0:1788625218.318197:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625218.318218:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206173440:0@lo:400:kworker.0 00000100:00100000:3.0:1788625218.318239:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625218.318257:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206173952:0@lo:400:kworker.0 00000100:00100000:3.0:1788625218.318278:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625218.318297:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206174464:0@lo:400:kworker.0 00000100:00100000:3.0:1788625218.318319:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625218.318345:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206173312 00000100:00100000:3.0:1788625218.318349:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206173312 00000100:00100000:3.0:1788625218.318375:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788625218.318382:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206173312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625218.318412:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206173824 00000100:00100000:2.0:1788625218.318419:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206173824 00000100:00100000:3.0:1788625218.318423:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206173312:12345-0@lo:400:kworker.0 Request processed in 42us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625218.318431:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788625218.318449:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206174336 00000100:00100000:2.0:1788625218.318454:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206174336 00000100:00100000:3.0:1788625218.318460:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206173952 00000100:00100000:3.0:1788625218.318466:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206173952 00000100:00100000:2.0:1788625218.318482:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206174464 00000100:00100000:2.0:1788625218.318488:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206174464 00000100:00100000:3.0:1788625218.318493:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788625218.318504:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206173824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625218.318513:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788625218.318548:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206174336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625218.318572:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206173824:12345-0@lo:400:kworker.0 Request processed in 71us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625218.318588:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788625218.318605:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788625218.318613:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206173952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625218.318620:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206174336:12345-0@lo:400:kworker.0 Request processed in 74us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625218.318629:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788625218.318648:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788625218.318653:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206173952:12345-0@lo:400:kworker.0 Request processed in 41us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625218.318659:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206174464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625218.318665:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788625218.318691:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206173440 00000100:00100000:3.0:1788625218.318695:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206173440 00000100:00100000:2.0:1788625218.318697:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206174464:12345-0@lo:400:kworker.0 Request processed in 42us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625218.318706:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788625218.318720:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788625218.318728:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206173440:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788625218.318729:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625218.318762:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206173440:12345-0@lo:400:kworker.0 Request processed in 36us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625218.318767:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788625218.318825:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206172928 00000100:00100000:1.0:1788625218.318829:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206172928 00000100:00100000:1.0:1788625218.318857:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788625218.318863:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3637:x1875509206172928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625218.318893:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3637:x1875509206172928:12345-0@lo:400:kworker.0 Request processed in 30us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625218.318898:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788625218.319361:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206172928:0@lo:400:kworker.0 00000100:00100000:3.0:1788625218.319376:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206173440:0@lo:400:kworker.0 00010000:00080000:3.0:1788625218.319387:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743977800 x1875509206173952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625218.319396:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206173952:0@lo:400:kworker.0 00000100:00100000:3.0:1788625218.319406:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788625218.319411:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99887cb12680, transno 4294967301 00000100:00100000:3.0:1788625218.319424:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206174464:0@lo:400:kworker.0 00000100:00100000:3.0:1788625218.319435:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206173312:0@lo:400:kworker.0 00010000:00080000:3.0:1788625218.319444:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743975500 x1875509206173824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625218.319463:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206173824:0@lo:400:kworker.0 00000100:00100000:3.0:1788625218.319475:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206174336:0@lo:400:kworker.0 00010000:00010000:0.0:1788625218.638260:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625218.827998:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625218.828020:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206174592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625218.828108:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625218.828172:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206174720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625218.828198:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625218.828286:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206174592 00000100:00100000:0.0:1788625218.828294:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206174592 00000100:00100000:0.0:1788625218.828345:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206174720 00000100:00100000:0.0:1788625218.828349:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206174720 00000100:00100000:0.0:1788625218.828365:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788625218.828374:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206174592:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625218.828399:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00002000:00000024:0.0:1788625218.828402:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625218.828408:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206174720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788625218.828417:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625218.828451:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206174720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625218.828457:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788625218.828579:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625218.828588:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206174848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625218.828620:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625218.828662:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206174848 00000100:00100000:3.0:1788625218.828665:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206174848 00000100:00100000:3.0:1788625218.828695:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788625218.828701:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206174848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788625218.828723:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788625218.828758:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206174848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625218.828765:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788625218.828803:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206174848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625218.830868:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206174720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625218.830868:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206174592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2486us (2752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625218.830894:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788625218.830910:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206174592:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788625219.659976:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625220.603476:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625220.603549:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185114240 00000100:00100000:2.0:1788625220.603564:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185114240 00000100:00100000:2.0:1788625220.603630:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 371 00000100:00100000:2.0:1788625220.603654:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2394:x1875509185114240:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625220.603746:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2394:x1875509185114240:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 106us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625220.603753:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 371 00000100:00100000:2.0:1788625220.609402:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625220.610839:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625220.616397:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185114368 00000100:00100000:3.0:1788625220.616418:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185114368 00000100:00100000:2.0:1788625220.616485:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625220.616505:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185114496 00000100:00100000:3.0:1788625220.616511:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185114496 00000100:00100000:2.0:1788625220.616535:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625220.616561:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185114880 00000100:00100000:3.0:1788625220.616565:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185114880 00000100:00100000:3.0:1788625220.616587:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 234 00000100:00100000:3.0:1788625220.616599:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185114368:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625220.616623:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00080000:2.0:1788625220.616654:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788625220.616659:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625220.616670:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185114752 00000100:00100000:2.0:1788625220.616675:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185114752 00000100:00100000:2.0:1788625220.616706:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 235 00000100:00100000:2.0:1788625220.616715:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185114496:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625220.616776:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185114496:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 62us (5944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625220.616784:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 235 00000100:00100000:2.0:1788625220.616805:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 236 00000100:00100000:2.0:1788625220.616811:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185114880:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625220.616837:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185114880:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625220.616839:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185114368:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 241us (7445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625220.616848:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 236 00000100:00100000:2.0:1788625220.616861:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 237 00000100:00100000:2.0:1788625220.616869:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185114752:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625220.616891:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185114752:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 23us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625220.616896:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 237 00000100:00080000:2.0:1788625220.616909:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625220.616917:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185114624 00000100:00100000:2.0:1788625220.616920:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185114624 00000100:00100000:3.0:1788625220.616931:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 234 00000100:00100000:2.0:1788625220.616954:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 94 00000100:00100000:2.0:1788625220.616961:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185114624:12345-192.168.204.14@tcp:400:kworker.0 00000100:00080000:3.0:1788625220.616980:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625220.616988:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185114624:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625220.616999:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 94 00010000:00010000:2.0:1788625220.683671:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625221.709572:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625221.836376:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788625221.836438:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788625222.412679:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206174976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788625222.412762:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625222.413419:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206174976 00000100:00100000:0.0:1788625222.413429:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206174976 00000100:00100000:0.0:1788625222.413490:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788625222.413500:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206174976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625222.413563:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788625222.417248:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206174976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3739us (4474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625222.417263:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788625222.420323:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206174976:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788625222.732629:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625222.924497:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206175232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625222.924616:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625222.924696:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625222.924703:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206175104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625222.924734:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625222.924947:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206175232 00000100:00100000:1.0:1788625222.924955:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206175232 00000100:00100000:1.0:1788625222.925020:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206175104 00000100:00100000:1.0:1788625222.925024:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206175104 00000100:00100000:1.0:1788625222.925042:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788625222.925049:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206175232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788625222.925077:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625222.925119:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206175232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625222.925125:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788625222.925139:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788625222.925145:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206175104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625222.925154:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625222.925171:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206175104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 27us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625222.925176:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1788625222.925216:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743aece00 x1875509206175104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625222.925234:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206175104:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788625222.925242:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887b4df480 x1875509206175232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625222.925252:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206175232:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788625222.925684:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625223.436396:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206175616:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.436659:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206175744:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.436715:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625223.436784:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206176256:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.436807:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625223.436858:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206175488:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.436881:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625223.436899:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206176000:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.436918:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625223.436938:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206176512:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.436960:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625223.436981:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788625223.436997:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206175360:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.437026:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625223.437050:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887b4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206175872:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.437073:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625223.437090:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206176384:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.437109:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625223.437135:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206175744 00000100:00100000:1.0:1788625223.437143:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206175744 00000100:00100000:1.0:1788625223.437181:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206176256 00000100:00100000:1.0:1788625223.437184:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206176256 00000100:00100000:1.0:1788625223.437205:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206175488 00000100:00100000:1.0:1788625223.437208:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206175488 00000100:00100000:1.0:1788625223.437216:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206176000 00000100:00100000:1.0:1788625223.437218:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206176000 00000100:00100000:1.0:1788625223.437229:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206176384 00000100:00100000:1.0:1788625223.437246:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206176384 00000100:00100000:1.0:1788625223.437264:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788625223.437272:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206175744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.437324:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206175744:12345-0@lo:400:kworker.0 Request processed in 52us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625223.437331:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788625223.437349:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788625223.437355:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206176256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.437382:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206176256:12345-0@lo:400:kworker.0 Request processed in 28us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625223.437387:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788625223.437397:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788625223.437402:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206175488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.437433:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206175488:12345-0@lo:400:kworker.0 Request processed in 30us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625223.437453:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788625223.437465:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788625223.437471:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206176000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.437499:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206176000:12345-0@lo:400:kworker.0 Request processed in 29us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625223.437659:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788625223.437672:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788625223.437679:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206176384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.437710:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206176384:12345-0@lo:400:kworker.0 Request processed in 32us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625223.437725:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788625223.437747:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206176512 00000100:00100000:1.0:1788625223.437751:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206176512 00000100:00100000:1.0:1788625223.437780:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788625223.437787:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206176512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.437818:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206176512:12345-0@lo:400:kworker.0 Request processed in 32us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625223.437825:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788625223.437843:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206175360 00000100:00100000:1.0:1788625223.437847:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206175360 00000100:00100000:1.0:1788625223.437874:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788625223.437879:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885ec08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206175360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.437908:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885ec08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206175360:12345-0@lo:400:kworker.0 Request processed in 29us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625223.437914:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788625223.437946:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206175872 00000100:00100000:1.0:1788625223.437949:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206175872 00000100:00100000:1.0:1788625223.437972:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788625223.437978:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206175872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.438021:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206175872:12345-0@lo:400:kworker.0 Request processed in 43us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625223.438028:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1788625223.438044:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625223.438049:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625223.438051:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625223.438080:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206175744:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.438102:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206176256:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.438133:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206175360:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.438143:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206175872:0@lo:400:kworker.0 00010000:00080000:1.0:1788625223.438154:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743684e00 x1875509206176384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625223.438164:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206176384:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.438173:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206175488:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.438181:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206176000:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.438189:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206176512:0@lo:400:kworker.0 00000100:00100000:3.0:1788625223.438706:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625223.438752:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206176128:0@lo:400:kworker.0 00000100:00100000:3.0:1788625223.438782:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625223.438881:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206176128 00000100:00100000:0.0:1788625223.438886:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206176128 00000100:00100000:0.0:1788625223.438935:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788625223.438943:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206176128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625223.438985:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206176128:12345-0@lo:400:kworker.0 Request processed in 43us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625223.439003:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1788625223.439061:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625223.439136:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206176640:0@lo:400:kworker.0 00000100:00100000:3.0:1788625223.439169:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788625223.439212:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743687480 x1875509206176128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625223.439224:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206176128:0@lo:400:kworker.0 00000100:00100000:2.0:1788625223.439287:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206176640 00000100:00100000:2.0:1788625223.439291:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206176640 00000100:00100000:2.0:1788625223.439337:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788625223.439344:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206176640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625223.439381:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206176640:12345-0@lo:400:kworker.0 Request processed in 39us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625223.439388:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1788625223.440074:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625223.440108:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206176640:0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.440192:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206175616 00000100:00100000:1.0:1788625223.440197:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206175616 00000100:00100000:1.0:1788625223.440242:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788625223.440251:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206175616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625223.440310:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206175616:12345-0@lo:400:kworker.0 Request processed in 61us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625223.440319:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788625223.440425:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887b4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206175616:0@lo:400:kworker.0 00010000:00010000:2.0:1788625223.755710:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625223.948568:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625223.948598:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206176768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625223.948681:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625223.948857:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206176768 00000100:00100000:1.0:1788625223.948866:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206176768 00000100:00100000:1.0:1788625223.948918:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788625223.948927:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206176768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625223.948962:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788625223.949026:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206176768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625223.949061:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788625223.949393:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206176896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625223.949429:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625223.949593:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206176768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625223.949644:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206176896 00000100:00100000:3.0:1788625223.949649:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206176896 00000100:00100000:3.0:1788625223.949842:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788625223.949851:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206176896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788625223.949873:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625223.950037:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206177024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625223.950076:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625223.950117:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206177024 00000100:00100000:0.0:1788625223.950120:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206177024 00000100:00100000:0.0:1788625223.950138:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788625223.950144:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206177024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788625223.950154:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625223.950197:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206177024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625223.950210:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788625223.950243:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206177024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625223.952231:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206176896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2372us (2791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625223.952245:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788625223.952611:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206176896:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788625224.780173:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625225.729400:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625225.729447:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625225.729482:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625225.729568:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185115008 00000100:00100000:2.0:1788625225.729579:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185115008 00000100:00100000:1.0:1788625225.729723:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185115264 00000100:00100000:1.0:1788625225.729728:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185115264 00000100:00100000:1.0:1788625225.729780:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185115136 00000100:00100000:1.0:1788625225.729783:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185115136 00000100:00100000:1.0:1788625225.729808:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 244 00000100:00100000:1.0:1788625225.729820:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185115264:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625225.729899:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185115264:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 82us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625225.729906:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 244 00000100:00100000:1.0:1788625225.729923:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 245 00000100:00100000:1.0:1788625225.729930:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185115136:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625225.729966:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185115136:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 36us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625225.729972:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 245 00000100:00100000:2.0:1788625225.730795:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 373 00000100:00100000:2.0:1788625225.730809:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2391:x1875509185115008:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625225.730849:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2391:x1875509185115008:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 45us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625225.730855:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 373 00000100:00080000:3.0:1788625225.731423:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625225.731430:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625225.731490:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625225.731603:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625225.731833:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625225.732241:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185115520 00000100:00100000:0.0:1788625225.732252:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185115520 00000100:00100000:0.0:1788625225.732319:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185115648 00000100:00100000:0.0:1788625225.732322:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185115648 00000100:00100000:0.0:1788625225.732343:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 246 00000100:00100000:0.0:1788625225.732352:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2392:x1875509185115520:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625225.732408:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2392:x1875509185115520:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 57us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625225.732415:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 246 00000100:00100000:0.0:1788625225.732429:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 247 00000100:00100000:0.0:1788625225.732436:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2392:x1875509185115648:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625225.732550:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2392:x1875509185115648:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 112us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625225.732557:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 247 00000100:00100000:0.0:1788625225.732606:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185115392 00000100:00100000:0.0:1788625225.732611:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185115392 00000100:00080000:3.0:1788625225.732832:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625225.732837:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625225.732839:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625225.732983:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 27 00000100:00100000:0.0:1788625225.732996:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2390:x1875509185115392:12345-192.168.204.14@tcp:9:kworker.0 00000020:00000080:0.0:1788625225.733017:0:8424:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a4e8 00000100:00080000:0.0:1788625225.733026:0:8424:0:(import.c:65:import_set_state_nolock()) ffff99887f8e6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788625225.733073:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1788625225.733208:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+2:2390:x1875509185115392:12345-192.168.204.14@tcp:9:kworker.0 Request processed in 215us (1374us total) trans 0 rc 0/0 00010000:00010000:2.0:1788625225.733287:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625225.738346:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 27 00010000:00010000:2.0:1788625225.804422:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625226.827771:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625227.531830:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206177152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788625227.531923:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625227.532112:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206177152 00000100:00100000:1.0:1788625227.532122:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206177152 00000100:00100000:1.0:1788625227.532181:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788625227.532193:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206177152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788625227.532229:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788625227.532287:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206177152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625227.532307:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788625227.532508:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206177152:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788625227.852204:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625228.043824:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206177280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625228.043918:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625228.044883:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206177280 00000100:00100000:0.0:1788625228.044892:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206177280 00000100:00100000:0.0:1788625228.044966:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788625228.044978:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206177280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625228.045014:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625228.045111:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206177408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625228.045147:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625228.045198:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206177408 00000100:00100000:3.0:1788625228.045203:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206177408 00000100:00100000:3.0:1788625228.045228:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788625228.045252:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206177408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788625228.045264:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788625228.045277:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625228.045302:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206177408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625228.045310:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1788625228.045370:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8a5500 x1875509206177408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625228.045388:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206177408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625228.050184:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206177280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5198us (6254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625228.050204:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:2.0:1788625228.050661:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743836300 x1875509206177280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625228.050685:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206177280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788625228.557683:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206177536:0@lo:400:kworker.0 00000100:00100000:2.0:1788625228.557749:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206177792:0@lo:400:kworker.0 00000100:00100000:1.0:1788625228.557768:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625228.557796:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625228.557831:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206178304:0@lo:400:kworker.0 00000100:00100000:1.0:1788625228.557831:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206178048:0@lo:400:kworker.0 00000100:00100000:0.0:1788625228.557863:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206177920:0@lo:400:kworker.0 00000100:00100000:1.0:1788625228.557874:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625228.557879:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625228.557919:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206178816:0@lo:400:kworker.0 00000100:00100000:0.0:1788625228.557924:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625228.557925:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206178560:0@lo:400:kworker.0 00000100:00100000:0.0:1788625228.557957:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206178432:0@lo:400:kworker.0 00000100:00100000:2.0:1788625228.557961:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625228.557968:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625228.557997:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788625228.557998:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625228.558008:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206177664:0@lo:400:kworker.0 00000100:00100000:1.0:1788625228.558016:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206177536 00000100:00100000:1.0:1788625228.558024:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206177536 00000100:00100000:2.0:1788625228.558040:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625228.558043:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206178304 00000100:00100000:0.0:1788625228.558049:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206178304 00000100:00100000:2.0:1788625228.558060:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206178176:0@lo:400:kworker.0 00000100:00100000:1.0:1788625228.558078:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788625228.558087:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625228.558091:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206177536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625228.558102:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206178688:0@lo:400:kworker.0 00000100:00100000:0.0:1788625228.558107:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206177920 00000100:00100000:0.0:1788625228.558112:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206177920 00000100:00100000:0.0:1788625228.558303:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206178560 00000100:00100000:0.0:1788625228.558307:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206178560 00000100:00100000:0.0:1788625228.558330:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206178432 00000100:00100000:0.0:1788625228.558332:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206178432 00000100:00100000:0.0:1788625228.558346:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206177664 00000100:00100000:0.0:1788625228.558349:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206177664 00000100:00100000:1.0:1788625228.558503:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206177536:12345-0@lo:400:kworker.0 Request processed in 415us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625228.558511:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788625228.558552:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206178176 00000100:00100000:0.0:1788625228.558557:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206178176 00000100:00100000:1.0:1788625228.558708:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206177792 00000100:00100000:1.0:1788625228.558713:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206177792 00000100:00100000:1.0:1788625228.558733:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206178048 00000100:00100000:1.0:1788625228.558736:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206178048 00000100:00100000:1.0:1788625228.558750:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788625228.558756:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206177792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625228.558795:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206177792:12345-0@lo:400:kworker.0 Request processed in 39us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625228.558801:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788625228.558811:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788625228.558816:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206178048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625228.558858:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206178048:12345-0@lo:400:kworker.0 Request processed in 42us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625228.558864:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788625228.559786:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625228.559846:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206177792:0@lo:400:kworker.0 00000100:00100000:2.0:1788625228.559893:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206178816 00000100:00100000:2.0:1788625228.559898:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206178816 00000100:00100000:2.0:1788625228.559934:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206178688 00000100:00100000:2.0:1788625228.559937:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206178688 00000100:00100000:2.0:1788625228.559960:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788625228.559978:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206178816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625228.560025:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206178816:12345-0@lo:400:kworker.0 Request processed in 50us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625228.560032:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788625228.560047:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788625228.560053:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206178688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625228.560080:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206178688:12345-0@lo:400:kworker.0 Request processed in 27us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625228.560086:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788625228.560112:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206178688:0@lo:400:kworker.0 00000100:00100000:2.0:1788625228.560123:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206178816:0@lo:400:kworker.0 00000100:00100000:2.0:1788625228.561007:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788625228.561022:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206178304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625228.561029:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788625228.561043:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206177920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625228.561078:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206178304:12345-0@lo:400:kworker.0 Request processed in 61us (3200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625228.561080:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788625228.561089:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788625228.561106:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206177920:12345-0@lo:400:kworker.0 Request processed in 66us (3183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625228.561111:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788625228.561119:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788625228.561123:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206178432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625228.561142:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788625228.561153:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206177664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625228.561159:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206178432:12345-0@lo:400:kworker.0 Request processed in 38us (3160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625228.561166:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788625228.561180:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788625228.561188:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206178176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625228.561276:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206177664:12345-0@lo:400:kworker.0 Request processed in 126us (3237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625228.561283:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:1.0:1788625228.561309:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625228.561315:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625228.561317:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788625228.561346:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206177536:0@lo:400:kworker.0 00000100:00100000:1.0:1788625228.561361:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206178048:0@lo:400:kworker.0 00000100:00100000:1.0:1788625228.561404:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206177920:0@lo:400:kworker.0 00000100:00100000:1.0:1788625228.561415:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206178432:0@lo:400:kworker.0 00000100:00100000:1.0:1788625228.561451:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206177664:0@lo:400:kworker.0 00010000:00080000:1.0:1788625228.561465:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8a5500 x1875509206178304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625228.561477:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206178560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625228.561487:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206178176:12345-0@lo:400:kworker.0 Request processed in 299us (3399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625228.561497:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206178304:0@lo:400:kworker.0 00000100:00100000:2.0:1788625228.561509:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788625228.561559:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206178176:0@lo:400:kworker.0 00000100:00100000:3.0:1788625228.561568:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206178560:12345-0@lo:400:kworker.0 Request processed in 476us (3599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625228.561577:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00080000:2.0:1788625228.561590:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8a6300 x1875509206178560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625228.561779:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206178560:0@lo:400:kworker.0 00010000:00010000:2.0:1788625228.875950:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625229.068173:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206178944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625229.068251:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625229.068333:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206179072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625229.068359:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625229.068860:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206179072 00000100:00100000:0.0:1788625229.068860:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206178944 00000100:00100000:2.0:1788625229.068869:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206179072 00000100:00100000:0.0:1788625229.068869:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206178944 00000100:00100000:0.0:1788625229.068926:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788625229.068927:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788625229.068935:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206179072:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625229.068935:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206178944:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:2.0:1788625229.068966:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625229.069010:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206179072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625229.069017:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000004:00000024:0.0:1788625229.069268:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788625229.069305:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206178944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 372us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625229.069311:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788625229.069433:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206179200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625229.069479:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625229.069769:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206179200 00000100:00100000:0.0:1788625229.069774:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206179200 00000100:00100000:0.0:1788625229.069812:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788625229.069819:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206179200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625229.069832:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625229.069862:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206179200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625229.069867:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788625229.070054:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206178944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625229.072071:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206179200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625229.073650:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206179072:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788625229.903920:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625230.846873:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625230.846976:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185115904 00000100:00100000:0.0:1788625230.846987:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185115904 00000100:00100000:0.0:1788625230.847062:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 254 00000100:00100000:0.0:1788625230.847074:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185115904:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625230.847152:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185115904:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 81us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625230.847160:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 254 00000100:00100000:1.0:1788625230.847469:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625230.847514:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625230.847632:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625230.847658:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625230.847679:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185116160 00000100:00100000:1.0:1788625230.847684:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185116160 00000100:00100000:1.0:1788625230.847718:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185116032 00000100:00100000:1.0:1788625230.847721:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185116032 00000100:00100000:1.0:1788625230.847736:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185116288 00000100:00100000:1.0:1788625230.847738:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185116288 00000100:00100000:1.0:1788625230.847755:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 255 00000100:00100000:1.0:1788625230.847826:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185116160:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625230.847881:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185116160:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 118us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625230.847897:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 255 00000100:00100000:0.0:1788625230.847998:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 256 00000100:00100000:0.0:1788625230.848006:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185116032:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625230.848039:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185116032:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 35us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625230.848046:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 256 00000100:00100000:0.0:1788625230.848061:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 257 00000100:00100000:0.0:1788625230.848068:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887b4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185116288:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625230.848090:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887b4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185116288:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625230.848096:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 257 00000100:00100000:1.0:1788625230.848149:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185115776 00000100:00100000:1.0:1788625230.848154:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185115776 00000100:00100000:1.0:1788625230.848217:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 375 00000100:00100000:1.0:1788625230.848224:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185115776:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625230.848249:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185115776:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 27us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625230.848256:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 375 00000100:00080000:3.0:1788625230.848387:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625230.848392:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788625230.924217:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625231.052178:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788625231.054561:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1788625231.638300:0:9503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000020:00000080:2.0:1788625231.638312:0:9503:0:(genops.c:885:class_export_put()) final put ffff99887f8e7800/1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000020:00000080:0.0:1788625231.638399:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887f8e7800/1338b3dc-3f02-4b26-a9aa-7a14f6033224 for lustre-OST0001 00000020:00000080:0.0:1788625231.640706:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887f8e6000 for lustre-OST0001 00010000:00010000:2.0:1788625231.951277:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625232.652179:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206179328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625232.652260:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625232.652793:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206179328 00000100:00100000:0.0:1788625232.652817:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206179328 00000100:00100000:0.0:1788625232.654323:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788625232.654335:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206179328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625232.654380:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788625232.654471:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206179328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625232.654479:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788625232.654559:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206179328:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788625232.972048:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625233.164307:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625233.164332:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206179456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625233.164406:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625233.164476:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206179456 00000100:00100000:2.0:1788625233.164492:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206179456 00000100:00100000:2.0:1788625233.164587:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788625233.164597:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206179456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788625233.164627:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625233.164676:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206179456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625233.164684:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1788625233.164705:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625233.166114:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206179584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625233.166166:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625233.166222:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206179584 00000100:00100000:0.0:1788625233.166228:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206179584 00000100:00100000:0.0:1788625233.166271:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788625233.166280:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206179584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625233.166301:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625233.166356:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206179584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625233.166363:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1788625233.166399:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887cb11c00 x1875509206179456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788625233.166399:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743974000 x1875509206179584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625233.166418:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206179456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625233.166418:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206179584:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788625233.166436:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625233.677218:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206179712:0@lo:400:kworker.0 00000100:00100000:1.0:1788625233.677281:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206179840:0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.677310:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625233.677323:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625233.677371:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206180224:0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.677403:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625233.677424:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206180736:0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.677449:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625233.677473:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788625233.677479:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206180096:0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.677502:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625233.677720:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206180608:0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.677745:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625233.677797:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206179968:0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.677822:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625233.677841:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206180480:0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.677866:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625233.677887:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206180992:0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.677912:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625233.677977:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206179712 00000100:00100000:0.0:1788625233.677984:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206179712 00000100:00100000:0.0:1788625233.678039:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788625233.678050:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206179712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.678103:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206179712:12345-0@lo:400:kworker.0 Request processed in 55us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625233.678111:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788625233.678145:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206179840 00000100:00100000:0.0:1788625233.678149:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206179840 00000100:00100000:0.0:1788625233.678170:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206180736 00000100:00100000:0.0:1788625233.678173:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206180736 00000100:00100000:0.0:1788625233.678199:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206180096 00000100:00100000:0.0:1788625233.678201:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206180096 00000100:00100000:0.0:1788625233.678213:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206180608 00000100:00100000:0.0:1788625233.678215:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206180608 00000100:00100000:0.0:1788625233.678230:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206180480 00000100:00100000:0.0:1788625233.678232:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206180480 00000100:00100000:0.0:1788625233.678247:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788625233.678255:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206179840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.678291:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206179840:12345-0@lo:400:kworker.0 Request processed in 36us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625233.678298:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788625233.678310:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788625233.678317:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206180736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.678346:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206180736:12345-0@lo:400:kworker.0 Request processed in 30us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625233.678352:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788625233.678363:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788625233.678368:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206180096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.678404:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206180096:12345-0@lo:400:kworker.0 Request processed in 35us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625233.678410:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788625233.678423:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788625233.678430:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206180608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.678456:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206180608:12345-0@lo:400:kworker.0 Request processed in 28us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625233.678463:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788625233.678473:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788625233.678479:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206180480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.678507:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206180480:12345-0@lo:400:kworker.0 Request processed in 28us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625233.678512:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788625233.678552:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206180224 00000100:00100000:0.0:1788625233.678556:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206180224 00000100:00100000:0.0:1788625233.678573:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206179968 00000100:00100000:0.0:1788625233.678576:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206179968 00000100:00100000:0.0:1788625233.678591:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788625233.678597:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206180224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.678648:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206180224:12345-0@lo:400:kworker.0 Request processed in 50us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625233.678654:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788625233.678666:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788625233.678672:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206179968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.678698:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206179968:12345-0@lo:400:kworker.0 Request processed in 26us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625233.678714:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788625233.678751:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206180992 00000100:00100000:0.0:1788625233.678755:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206180992 00000100:00100000:0.0:1788625233.678797:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788625233.678804:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206180992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.678840:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206180992:12345-0@lo:400:kworker.0 Request processed in 37us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625233.678846:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1788625233.678864:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625233.678868:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788625233.678871:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625233.678900:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206179968:0@lo:400:kworker.0 00010000:00080000:0.0:1788625233.678912:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743b30e00 x1875509206180480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625233.678922:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206180480:0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.678932:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206180992:0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.678966:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206180096:0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.678976:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206180608:0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.678985:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206180224:0@lo:400:kworker.0 00010000:00080000:0.0:1788625233.678995:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743b32d80 x1875509206180736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625233.679005:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206180736:0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.679017:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206179712:0@lo:400:kworker.0 00000100:00100000:1.0:1788625233.680790:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206179840:0@lo:400:kworker.0 00000100:00100000:1.0:1788625233.680804:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206180352:0@lo:400:kworker.0 00000100:00100000:1.0:1788625233.680852:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625233.680954:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206180864:0@lo:400:kworker.0 00000100:00100000:1.0:1788625233.680981:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625233.681050:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206180352 00000100:00100000:0.0:1788625233.681056:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206180352 00000100:00100000:0.0:1788625233.681106:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788625233.681113:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206180352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625233.681154:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206180352:12345-0@lo:400:kworker.0 Request processed in 42us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625233.681161:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:0.0:1788625233.681180:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625233.681234:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206180352:0@lo:400:kworker.0 00000100:00100000:2.0:1788625233.687919:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206180864 00000100:00100000:2.0:1788625233.687939:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206180864 00000100:00100000:2.0:1788625233.688017:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788625233.688028:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206180864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625233.688146:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206180864:12345-0@lo:400:kworker.0 Request processed in 120us (7163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625233.688154:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1788625233.688179:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625233.688225:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206180864:0@lo:400:kworker.0 00010000:00010000:2.0:1788625233.997575:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625234.187848:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987438cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206181120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625234.187954:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625234.188662:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206181248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625234.188702:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625234.188808:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206181248 00000100:00100000:2.0:1788625234.188817:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206181248 00000100:00100000:2.0:1788625234.188883:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788625234.188893:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206181248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625234.188923:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625234.188976:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206181248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625234.188984:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788625234.189129:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206181248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625234.189537:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625234.189549:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206181376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625234.189588:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625234.189675:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206181376 00000100:00100000:0.0:1788625234.189681:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206181376 00000100:00100000:0.0:1788625234.189715:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788625234.189723:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206181376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625234.189734:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625234.189781:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206181376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625234.189787:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788625234.189825:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206181376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625234.190218:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206181120 00000100:00100000:3.0:1788625234.190224:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206181120 00000100:00100000:3.0:1788625234.190263:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788625234.190270:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206181120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788625234.190300:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788625234.190355:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206181120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (2402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625234.190361:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788625234.190471:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987438cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206181120:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1788625235.012851:0:14052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:20:32 (1788625232) 00010000:00010000:2.0:1788625235.019714:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625235.971069:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625235.972676:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625235.972756:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625235.972927:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185116672 00000100:00100000:0.0:1788625235.972941:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185116672 00000100:00100000:0.0:1788625235.973041:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185116928 00000100:00100000:0.0:1788625235.973046:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185116928 00000100:00100000:0.0:1788625235.973080:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 264 00000100:00100000:0.0:1788625235.973094:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185116672:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625235.973250:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185116672:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 157us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625235.973260:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 264 00000100:00100000:0.0:1788625235.973283:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 265 00000100:00100000:0.0:1788625235.973290:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185116928:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625235.973316:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185116928:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 26us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625235.973322:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 265 00000100:00080000:1.0:1788625235.974350:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788625235.975350:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185116416 00000100:00100000:2.0:1788625235.975367:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185116416 00000100:00100000:2.0:1788625235.975454:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 377 00000100:00100000:2.0:1788625235.975466:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185116416:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625235.976381:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185116416:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 914us (5326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625235.976392:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 377 00000100:00100000:0.0:1788625235.989206:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625235.989462:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625235.989641:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185116544 00000100:00100000:3.0:1788625235.989656:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185116544 00000100:00100000:3.0:1788625235.989845:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185116800 00000100:00100000:3.0:1788625235.989869:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185116800 00000100:00100000:3.0:1788625235.989918:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 266 00000100:00100000:3.0:1788625235.989930:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185116544:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625235.990061:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185116544:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 133us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625235.990069:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 266 00000100:00100000:3.0:1788625235.990093:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 267 00000100:00100000:3.0:1788625235.990101:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185116800:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625235.990125:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185116800:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 26us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625235.990132:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 267 00000100:00080000:0.0:1788625235.992121:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788625236.043881:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625236.476942:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625236.477098:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185117056 00000100:00100000:3.0:1788625236.477116:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185117056 00000100:00100000:3.0:1788625236.477213:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 40 00000100:00100000:3.0:1788625236.477228:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:11083:x1875509185117056:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625236.477260:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625236.477302:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a5c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e075 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625236.477426:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7a5cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625236.477447:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7a5cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625236.477467:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7a5cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625236.477613:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788625236.477619:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788625236.477673:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7a5cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625236.477706:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a5c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e075 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625236.477743:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7a5cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e075 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625236.477755:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99885129c800) 00010000:00010000:3.0:1788625236.477759:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625236.477763:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682a00, rc 0) 00000100:00100000:3.0:1788625236.477863:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:11083:x1875509185117056:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 639us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625236.477871:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 40 00000100:00100000:3.0:1788625236.497927:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625236.498849:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185117184 00000100:00100000:0.0:1788625236.498867:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185117184 00000100:00100000:0.0:1788625236.498965:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 41 00000100:00100000:0.0:1788625236.498978:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:11084:x1875509185117184:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625236.499009:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625236.499047:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7a5d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e07c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499158:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a5dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499188:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a5dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499204:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a5dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499261:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a5e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499270:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499278:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499652:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882170e00/0x2d2e3b3f34a7a5eb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499663:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882170e00/0x2d2e3b3f34a7a5eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499672:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882170e00/0x2d2e3b3f34a7a5eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625236.499739:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788625236.499744:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625236.499774:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998882170e00/0x2d2e3b3f34a7a5eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499787:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a5dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499795:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a5dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499803:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a5dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499821:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625236.499829:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a5dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499838:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a5dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499855:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99885129c800) 00010000:00010000:0.0:1788625236.499858:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625236.499864:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a5dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499871:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a5dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499891:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499897:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a5e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499903:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499908:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625236.499911:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499917:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a5e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499936:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9988749c3c00) 00010000:00010000:0.0:1788625236.499939:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625236.499943:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a5e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499950:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a5e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.499992:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7a5d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e07c expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.500007:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998882170e00/0x2d2e3b3f34a7a5eb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e07c expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625236.500014:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9988749c3d00) 00010000:00010000:0.0:1788625236.500017:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625236.500019:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882170e00, rc 0) 00000100:00100000:0.0:1788625236.504566:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:11084:x1875509185117184:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 5570us (6635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625236.504584:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 41 00000100:00100000:1.0:1788625236.509648:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625236.509763:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185117312 00000100:00100000:3.0:1788625236.509780:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185117312 00000100:00100000:3.0:1788625236.509930:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:3.0:1788625236.509946:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:11084:x1875509185117312:12345-192.168.204.14@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788625236.510072:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:11084:x1875509185117312:12345-192.168.204.14@tcp:900:lhsmtool_posix.0 Request processed in 129us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625236.510080:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:1.0:1788625236.518986:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625236.519204:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185117568 00000100:00100000:2.0:1788625236.519223:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185117568 00000100:00100000:2.0:1788625236.519353:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 42 00000100:00100000:2.0:1788625236.519367:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:11084:x1875509185117568:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625236.519397:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625236.519437:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a5f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e083 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.519585:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a5f9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.519605:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a5f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.519618:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a5f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.521253:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a600 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.521280:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a600 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.521293:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a600 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.521419:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a607 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.521428:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a607 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.521436:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a607 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625236.521447:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788625236.521591:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a5f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.522780:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a5f9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.522797:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a5f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.522804:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625236.522809:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a5f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.522843:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a5f9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.522861:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9988749c3d00) 00010000:00010000:2.0:1788625236.522864:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625236.522869:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a5f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.522877:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a5f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.522898:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a600 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.522904:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a600 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.522909:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a600 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.522915:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625236.522917:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a600 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.522924:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a600 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.522931:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff998743548700) 00010000:00010000:2.0:1788625236.522934:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625236.522936:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a600 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.522965:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a600 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.526351:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a5f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e083 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.526382:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a607 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e083 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625236.526392:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998743548200) 00010000:00010000:2.0:1788625236.526396:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625236.526400:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7400, rc 0) 00000100:00100000:2.0:1788625236.526487:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:11084:x1875509185117568:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 7122us (7517us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788625236.526499:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 42 00000100:00100000:0.0:1788625236.533028:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625236.533338:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185117696 00000100:00100000:3.0:1788625236.533363:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185117696 00000100:00100000:3.0:1788625236.533458:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 43 00000100:00100000:3.0:1788625236.533471:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:11084:x1875509185117696:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788625236.534130:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:11084:x1875509185117696:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 Request processed in 659us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625236.534141:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 43 00000100:00100000:1.0:1788625236.547167:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625236.549072:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185117824 00000100:00100000:0.0:1788625236.549092:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185117824 00000100:00100000:0.0:1788625236.549189:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 44 00000100:00100000:0.0:1788625236.549203:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:11084:x1875509185117824:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1788625236.550913:0:6513:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1424us 00000100:00100000:0.0:1788625236.563624:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:11084:x1875509185117824:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 Request processed in 14407us (16457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625236.563655:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 44 00010000:00010000:2.0:1788625237.067708:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788625237.197687:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788625237.197932:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788625237.771819:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206181504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625237.771901:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625237.772465:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206181504 00000100:00100000:3.0:1788625237.772476:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206181504 00000100:00100000:3.0:1788625237.772556:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788625237.772567:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206181504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788625237.772604:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788625237.781273:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206181504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8693us (9356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625237.781291:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788625237.781578:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206181504:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788625238.093258:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625238.283794:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206181632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625238.283875:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625238.283952:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206181632 00000100:00100000:2.0:1788625238.283961:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206181632 00000100:00100000:2.0:1788625238.284017:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788625238.284028:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206181632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625238.284060:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625238.284117:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206181632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625238.284131:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1788625238.284153:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788625238.284293:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998848a84a80 x1875509206181632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625238.284313:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206181632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625238.284329:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625238.284336:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206181760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625238.284364:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625238.284989:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206181760 00000100:00100000:0.0:1788625238.284996:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206181760 00000100:00100000:0.0:1788625238.285044:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788625238.285052:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206181760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625238.285066:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625238.285118:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206181760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625238.285124:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1788625238.285153:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998848a87b80 x1875509206181760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625238.285169:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206181760:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788625238.285455:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625238.345479:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625238.345638:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185117952 00000100:00100000:3.0:1788625238.345649:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185117952 00000100:00100000:3.0:1788625238.345725:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 45 00000100:00100000:3.0:1788625238.345744:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987438cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:11126:x1875509185117952:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625238.345776:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625238.345797:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e08a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.345862:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a61c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.345878:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a61c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.345890:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a61c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.345924:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a623 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.345933:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a623 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.345941:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a623 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.345985:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a61c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.345993:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a61c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.346000:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a61c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.346015:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625238.346019:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a61c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.346026:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a61c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.346039:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99885129c800) 00010000:00010000:3.0:1788625238.346041:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625238.346046:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a61c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.346053:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a61c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.346064:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a623 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.346069:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a623 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.346076:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a623 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.346082:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625238.346085:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a623 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.346091:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a623 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.346109:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9988606b3300) 00010000:00010000:3.0:1788625238.346112:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625238.346115:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a623 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.346121:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a623 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.346156:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a615 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e08a expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.346166:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99885129c800) 00010000:00010000:3.0:1788625238.346168:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625238.346172:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e08a expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.346181:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683600, rc 0) 00000100:00100000:3.0:1788625238.346239:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987438cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:11126:x1875509185117952:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 498us (767us total) trans 0 rc 301/301 00000100:00100000:3.0:1788625238.346246:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 45 00000100:00080000:3.0:1788625238.346273:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625238.353590:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625238.354595:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185118208 00000100:00100000:0.0:1788625238.354609:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185118208 00000100:00100000:0.0:1788625238.354721:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 46 00000100:00100000:0.0:1788625238.354733:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:11126:x1875509185118208:12345-192.168.204.14@tcp:36:lfs.0 00010000:00010000:0.0:1788625238.354796:0:11318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625238.354826:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7a5cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e075 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.354845:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99885129c800) 00010000:00010000:0.0:1788625238.354858:0:11318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625238.355017:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7a62a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.355033:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7a62a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.355045:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7a62a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.355058:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a631 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.355066:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a631 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.355073:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a631 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.356587:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a638 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.356607:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a638 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.356618:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a638 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625238.356635:0:11318:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ebb678a reply state 00000000fa3a3e94 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a638 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.356647:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a638 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.356654:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:0.0:1788625238.356696:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788625238.356701:0:11318:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788625238.356707:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788625238.356717:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7a62a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.356723:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7a62a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.356729:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7a62a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.356734:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625238.356739:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7a62a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.356746:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7a62a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.356765:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:0.0:1788625238.356768:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625238.356771:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7a62a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.356778:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7a62a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625238.356797:0:11318:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ebb678a reply state 00000000fa3a3e94 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a631 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.356806:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a631 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.356822:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9988749c9900) 00010000:00010000:0.0:1788625238.356825:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788625238.356827:0:11318:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788625238.357085:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:11126:x1875509185118208:12345-192.168.204.14@tcp:36:lfs.0 Request processed in 2352us (3502us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788625238.357095:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 46 00000100:00100000:1.0:1788625238.443824:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625238.443963:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185118336 00000100:00100000:0.0:1788625238.443972:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185118336 00000100:00100000:0.0:1788625238.444071:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 47 00000100:00100000:0.0:1788625238.444082:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:11134:x1875509185118336:12345-192.168.204.14@tcp:101:lctl.0 00010000:00010000:0.0:1788625238.444117:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625238.444142:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7a63f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e091 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.444213:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a646 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.444228:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.444239:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625238.444282:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788625238.444285:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625238.444321:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.444341:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7a63f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e091 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.444369:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a646 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e091 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.444472:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:0.0:1788625238.444476:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625238.444480:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994c00, rc 0) 00000100:00100000:2.0:1788625238.445012:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:11134:x1875509185118336:12345-192.168.204.14@tcp:101:lctl.0 Request processed in 929us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625238.445021:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 47 00000100:00100000:1.0:1788625238.510624:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625238.510964:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185118464 00000100:00100000:3.0:1788625238.510977:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185118464 00000100:00100000:3.0:1788625238.511043:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 48 00000100:00100000:3.0:1788625238.511054:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:11140:x1875509185118464:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:3.0:1788625238.511078:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625238.511104:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a64d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e098 expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511198:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a654 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511215:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a654 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511227:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a654 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511237:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a65b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511244:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a65b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511251:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a65b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511338:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7a662 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511347:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7a662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511355:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7a662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625238.511395:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788625238.511399:0:9824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788625238.511444:0:9824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7a662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511469:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a654 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511477:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a654 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511483:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a654 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511489:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625238.511494:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a654 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511502:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a654 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511547:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:3.0:1788625238.511551:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625238.511557:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511565:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511733:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a65b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511741:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a65b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511812:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a65b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511826:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625238.511829:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a65b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511835:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a65b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511844:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9988749c9900) 00010000:00010000:3.0:1788625238.511847:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625238.511849:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a65b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511855:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a65b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511887:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a64d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e098 expref: 13 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511902:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7a662 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e098 expref: 12 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.511909:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:3.0:1788625238.511912:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788625238.511914:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682a00, rc 0) 00000100:00100000:3.0:1788625238.511993:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+12:11140:x1875509185118464:12345-192.168.204.14@tcp:101:bash.0 Request processed in 942us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625238.512002:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 48 00000100:00100000:1.0:1788625238.517703:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625238.517808:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185118720 00000100:00100000:0.0:1788625238.517818:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185118720 00000100:00100000:0.0:1788625238.517888:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 49 00000100:00100000:0.0:1788625238.517899:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+12:11140:x1875509185118720:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:0.0:1788625238.517922:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625238.517945:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a669 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e09f expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518055:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a670 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518070:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a670 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518096:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a670 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518111:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a677 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518117:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a677 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518147:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a677 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788625238.518489:0:11318:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788625238.518668:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a67e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518679:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518704:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518738:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a670 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518746:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a670 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518753:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a670 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518759:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625238.518764:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a670 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518773:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a670 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518786:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:0.0:1788625238.518789:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625238.518804:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a670 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518811:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a670 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625238.518825:0:11318:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000929cb5be reply state 000000003e8b91f2 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a677 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518837:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a677 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518843:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988749c9f00) 00010000:00010000:0.0:1788625238.518845:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788625238.518847:0:11318:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788625238.518882:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a669 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e09f expref: 15 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518897:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a67e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e09f expref: 14 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.518904:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c9d00) 00010000:00010000:0.0:1788625238.518907:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625238.518910:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995c00, rc 0) 00000100:00100000:0.0:1788625238.518985:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+15:11140:x1875509185118720:12345-192.168.204.14@tcp:101:bash.0 Request processed in 1088us (1301us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788625238.518994:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 49 00000100:00100000:3.0:1788625238.524205:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625238.524303:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185118848 00000100:00100000:0.0:1788625238.524313:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185118848 00000100:00100000:0.0:1788625238.524369:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 28 00000100:00100000:0.0:1788625238.524387:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1875509185118848:12345-192.168.204.14@tcp:8:bash.0 00010000:00080000:0.0:1788625238.524432:0:8423:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp t0 exp 0000000000000000 cur 359 last 0 00000020:00000080:0.0:1788625238.524468:0:8423:0:(genops.c:1385:class_connect()) connect: client 1338b3dc-3f02-4b26-a9aa-7a14f6033224, cookie 0x2d2e3b3f34a7a68c 00002000:00100000:0.0:1788625238.524481:0:8423:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1338b3dc-3f02-4b26-a9aa-7a14f6033224/ffff998743af7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788625238.524493:0:8423:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788625238.524616:0:8423:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788625238.524648:0:8423:0:(import.c:65:import_set_state_nolock()) ffff998743af0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625238.524725:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2390:x1875509185118848:12345-192.168.204.14@tcp:8:bash.0 Request processed in 337us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625238.524732:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 28 00000100:00100000:1.0:1788625238.528968:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625238.529067:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185118976 00000100:00100000:2.0:1788625238.529077:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185118976 00000100:00100000:2.0:1788625238.529222:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 29 00000100:00100000:2.0:1788625238.529233:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:0:x1875509185118976:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625238.529252:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625238.529275:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a693 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e0a6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625238.529303:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625238.529320:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1788625238.529324:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625238.529332:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a693 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0a6 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.529350:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a693 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0a6 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.529363:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6400, rc 0) 00000100:00100000:2.0:1788625238.529422:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:0:x1875509185118976:12345-192.168.204.14@tcp:101:bash.0 Request processed in 192us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625238.529429:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 29 00000100:00080000:3.0:1788625238.529670:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625238.533762:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625238.535413:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185119104 00000100:00100000:0.0:1788625238.535432:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185119104 00000100:00100000:0.0:1788625238.535705:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 30 00000100:00100000:0.0:1788625238.535718:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:11140:x1875509185119104:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:0.0:1788625238.535738:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625238.535762:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e0ad expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.535870:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a693 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0a6 expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.535880:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625238.535885:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625238.535891:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.535930:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a693 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0a6 expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.535958:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a693 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0a6 expref: 8 pid: 8424 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625238.535975:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8423:1875509206181888:192.168.204.14@tcp:104: 00000100:00100000:0.0:1788625238.536111:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743550000 going to sleep for 11 seconds 00000100:00100000:0.0:1788625238.543628:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625238.544015:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185119232 00000100:00100000:1.0:1788625238.544025:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185119232 00010000:00010000:1.0:1788625238.544068:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a693 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0a6 expref: 9 pid: 8424 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625238.544113:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 52 00000100:00100000:1.0:1788625238.544123:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:2393:x1875509185119232:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625238.544140:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625238.544165:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a693 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0a6 expref: 9 pid: 8424 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.544203:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a693 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0a6 expref: 9 pid: 8424 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.544231:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625238.544235:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625238.544244:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 9 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.544253:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 9 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.544290:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 9 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625238.544304:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b30000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1875509206182016:192.168.204.14@tcp:105: 00000100:00100000:1.0:1788625238.544387:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1fe40 going to sleep for 11 seconds 00010000:00010000:2.0:1788625238.545209:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a693 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0a6 expref: 9 pid: 8424 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625238.545228:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8423:1875509206181888:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625238.545253:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.545265:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994400, rc 0) 00000100:00100000:2.0:1788625238.545354:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:11140:x1875509185119104:12345-192.168.204.14@tcp:101:bash.0 Request processed in 9638us (11601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625238.545364:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 30 00000100:00100000:1.0:1788625238.550103:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b30000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1875509206182016:192.168.204.14@tcp:105: 00010000:00010000:1.0:1788625238.550132:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625238.550244:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185119232:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 6121us (6626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625238.550256:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 52 00000100:00100000:3.0:1788625238.552235:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625238.552467:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185119488 00000100:00100000:0.0:1788625238.552477:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185119488 00000100:00100000:0.0:1788625238.552565:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:0.0:1788625238.552578:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+15:11140:x1875509185119488:12345-192.168.204.14@tcp:35:bash.0 00000100:00100000:0.0:1788625238.553096:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:11140:x1875509185119488:12345-192.168.204.14@tcp:35:bash.0 Request processed in 518us (867us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788625238.553105:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:3.0:1788625238.644398:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625238.644761:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185119744 00000100:00100000:2.0:1788625238.644771:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185119744 00000100:00100000:2.0:1788625238.644834:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 50 00000100:00100000:2.0:1788625238.644844:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:11150:x1875509185119744:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625238.644944:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625238.644967:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a6a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e0b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625238.645073:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788625238.645184:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a6a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0b4 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.645200:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:2.0:1788625238.645203:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625238.645208:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a6a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0b4 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.645243:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6400, rc 0) 00000100:00100000:2.0:1788625238.645363:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+17:11150:x1875509185119744:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 519us (975us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1788625238.645371:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 50 00000100:00100000:0.0:1788625238.649323:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625238.649421:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185120000 00000100:00100000:3.0:1788625238.649497:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185120000 00000100:00100000:3.0:1788625238.649989:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:3.0:1788625238.650001:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+17:11150:x1875509185120000:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:3.0:1788625238.650253:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:11150:x1875509185120000:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 254us (938us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788625238.650261:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:1.0:1788625238.734670:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625238.735385:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185120128 00000100:00100000:3.0:1788625238.735397:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185120128 00000100:00100000:3.0:1788625238.735465:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 51 00000100:00100000:3.0:1788625238.735475:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:11156:x1875509185120128:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625238.735500:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625238.735572:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a6af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e0bb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.735654:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a6b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.735669:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.735693:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625238.735736:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788625238.736053:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788625238.736078:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.736106:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a6af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0bb expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.736127:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a6b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0bb expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.736136:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:3.0:1788625238.736139:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625238.736143:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683c00, rc 0) 00000100:00100000:3.0:1788625238.736299:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:11156:x1875509185120128:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 825us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625238.736308:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 51 00000100:00100000:1.0:1788625238.742139:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625238.742260:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185120384 00000100:00100000:3.0:1788625238.742271:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185120384 00000100:00100000:3.0:1788625238.742386:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 52 00000100:00100000:3.0:1788625238.742396:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:11156:x1875509185120384:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625238.742418:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625238.742438:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a6bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e0c2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.742597:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a6c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.742612:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.742642:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625238.742655:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788625238.742788:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a6bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0c2 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.742808:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0c2 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.742817:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c9d00) 00010000:00010000:3.0:1788625238.742820:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625238.742824:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682200, rc 0) 00000100:00100000:3.0:1788625238.742967:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:11156:x1875509185120384:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 571us (836us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788625238.742976:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 52 00000100:00100000:0.0:1788625238.747705:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625238.747970:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185120640 00000100:00100000:3.0:1788625238.747981:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185120640 00000100:00100000:3.0:1788625238.748077:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 53 00000100:00100000:3.0:1788625238.748087:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:11156:x1875509185120640:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625238.748112:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625238.748133:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a6d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e0c9 expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.748237:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7a6d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.748271:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7a6d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.748283:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7a6d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625238.748297:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788625238.748396:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a6d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0c9 expref: 24 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.748413:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7a6d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0c9 expref: 23 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.748422:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c9d00) 00010000:00010000:3.0:1788625238.748425:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788625238.748429:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683200, rc 0) 00000100:00100000:3.0:1788625238.748496:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+23:11156:x1875509185120640:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 411us (800us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788625238.748503:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 53 00000100:00100000:1.0:1788625238.755305:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625238.755875:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185120768 00000100:00100000:3.0:1788625238.755887:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185120768 00000100:00100000:3.0:1788625238.755959:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:3.0:1788625238.755975:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+23:2393:x1875509185120768:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625238.755992:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625238.756022:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a6c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0c2 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625238.756057:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c9d00) 00010000:00010000:3.0:1788625238.756063:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625238.756122:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:2393:x1875509185120768:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 147us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625238.756132:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:1.0:1788625238.767492:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625238.767691:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185120896 00000100:00100000:2.0:1788625238.767702:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185120896 00000100:00100000:2.0:1788625238.767875:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 31 00000100:00100000:2.0:1788625238.767888:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2394:x1875509185120896:12345-192.168.204.14@tcp:1:lfs.0 00010000:00010000:2.0:1788625238.767945:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a6e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.767965:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 7 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.767974:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625238.767978:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788625238.767984:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a6e7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.768020:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 7 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.768035:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 7 pid: 8423 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625238.768070:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8425:1875509206182144:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625238.768179:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887cabee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625238.771935:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625238.772220:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185121024 00000100:00100000:1.0:1788625238.772230:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185121024 00002000:00100000:1.0:1788625238.772279:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff998848a84e00 x1875509185121024/t0(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:49/0 lens 504/0 e 0 to 0 dl 1788625249 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625238.772291:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998848a84e00 with x1875509185121024 ext(0->12) 00010000:00010000:1.0:1788625238.772300:0:8429:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 8 pid: 8423 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.772317:0:8429:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 8 pid: 8423 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625238.772324:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff998848a84e00 00000100:00100000:1.0:1788625238.772408:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:1.0:1788625238.772418:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2394:x1875509185121024:12345-192.168.204.14@tcp:4:lfs.0 00000100:00100000:2.0:1788625238.772951:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8425:1875509206182144:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625238.772984:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a6e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788625238.774810:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000100:00100000:1.0:1788625238.775722:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:2394:x1875509185121024:12345-192.168.204.14@tcp:4:lfs.0 Request processed in 3299us (3790us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788625238.775733:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 0 00002000:00100000:1.0:1788625238.775750:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff998848a84e00 x1875509185121024/t4294967300(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:49/0 lens 504/448 e 0 to 0 dl 1788625249 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625238.775760:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998848a84e00 with x1875509185121024 ext(0->12) 00010000:00010000:1.0:1788625238.775770:0:8429:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 9 pid: 8423 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.775792:0:8429:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 9 pid: 8423 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625238.775811:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff998848a84e00 00000100:00100000:1.0:1788625238.779533:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625238.779614:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185121152 00000100:00100000:2.0:1788625238.779624:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185121152 00010000:00010000:2.0:1788625238.779665:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 9 pid: 8423 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625238.779841:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 53 00000100:00100000:2.0:1788625238.779853:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:2394:x1875509185121152:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625238.779869:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788625238.779888:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788625238.779890:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788625237 00002000:00010000:2.0:1788625238.779893:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788625237 00002000:00010000:2.0:1788625238.779895:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788625237 00002000:00010000:2.0:1788625238.779897:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788625238.779903:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 9 pid: 8423 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.779919:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 9 pid: 8423 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.779961:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a69a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ad expref: 9 pid: 8423 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.779978:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788625238.779982:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788625238.779987:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a6e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.779998:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a6e7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.780026:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625238.780046:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a6e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.780055:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a6e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.780076:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a6e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.780085:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a6e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.780093:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a6e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.780100:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625238.780105:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a6e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.780114:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a6e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.780126:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a6e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.780142:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc7f014a/0x2d2e3b3f34a7a6e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625238.780169:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2394:x1875509185121152:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 319us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625238.780177:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 53 00000100:00100000:1.0:1788625238.780191:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2394:x1875509185120896:12345-192.168.204.14@tcp:1:lfs.0 Request processed in 12308us (12709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625238.780199:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 31 00000100:00100000:2.0:1788625238.783251:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625238.783349:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185121408 00000100:00100000:0.0:1788625238.783359:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185121408 00000100:00100000:0.0:1788625238.783429:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00100000:0.0:1788625238.783439:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:11156:x1875509185121408:12345-192.168.204.14@tcp:35:lfs.0 00000004:00010000:0.0:1788625238.783510:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7a6d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0c9 expref: 22 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788625238.783835:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1788625238.783881:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788625238.784190:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1788625238.784226:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a6ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.784241:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a67e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e09f expref: 26 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.784251:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a6ee lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.784286:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a67e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e09f expref: 26 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.784302:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a67e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e09f expref: 26 pid: 11318 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625238.784316:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6514:1875509206182272:192.168.204.14@tcp:104: 00000100:00100000:0.0:1788625238.784404:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743550480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625238.788940:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6514:1875509206182272:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625238.788973:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a6ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625238.789897:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625238.790090:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185121536 00000100:00100000:1.0:1788625238.790099:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185121536 00010000:00010000:1.0:1788625238.790137:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a67e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e09f expref: 27 pid: 11318 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625238.790168:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 54 00000100:00100000:1.0:1788625238.790177:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+27:2394:x1875509185121536:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625238.790193:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625238.790200:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a67e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e09f expref: 27 pid: 11318 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.790212:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a67e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e09f expref: 27 pid: 11318 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.790235:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a67e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e09f expref: 27 pid: 11318 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.790251:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c9d00) 00010000:00010000:1.0:1788625238.790256:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a6ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.790280:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a6ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.790287:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a6ee lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.790320:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625238.790384:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+26:2394:x1875509185121536:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 207us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625238.790391:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 54 00010000:00010000:0.0:1788625238.790452:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a6ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.790460:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a6ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788625238.790626:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1788625238.791070:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1788625238.791180:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875509206182400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788625238.791235:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625238.791268:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743550c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625238.791439:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206182400 00000100:00100000:1.0:1788625238.791445:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206182400 00000100:00100000:1.0:1788625238.791493:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788625238.791502:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1875509206182400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788625238.791631:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1875509206182400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 130us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625238.791638:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788625238.791688:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875509206182400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788625238.792044:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1788625238.792105:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743975f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875509206182528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788625238.792157:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625238.792178:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788625238.792199:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206182528 00000100:00100000:1.0:1788625238.792203:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206182528 00000100:00100000:1.0:1788625238.792224:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788625238.792231:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1875509206182528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788625238.792330:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6514:x1875509206182528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 99us (172us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788625238.792338:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788625238.792381:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743975f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875509206182528:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788625238.792490:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1788625238.792646:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a6ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.792657:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a6ee lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.792664:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a6ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.792670:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625238.792674:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a6ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.792693:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a6ee lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.792716:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c9d00) 00010000:00010000:1.0:1788625238.792718:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788625238.792723:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a6ee lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.792729:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a6ee lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788625238.793298:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788625238.793383:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788625238.793396:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359900878166ns, next at 360900875976ns, rc = 0 00000001:00080000:1.0:1788625238.793402:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1788625238.793429:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c9d00) 00010000:00010000:1.0:1788625238.793432:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788625238.793440:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7a6d9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0c9 expref: 30 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625238.793576:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+29:11156:x1875509185121408:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 10138us (10337us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1788625238.793585:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 8 00000020:00080000:1.0:1788625238.793591:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788625238.795880:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206182784:0@lo:400:kworker.0 00000100:00100000:3.0:1788625238.795950:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625238.795983:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206183296:0@lo:400:kworker.0 00000100:00100000:3.0:1788625238.796002:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625238.796021:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788625238.796026:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206182656:0@lo:400:kworker.0 00000100:00100000:3.0:1788625238.796157:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625238.796254:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206183168:0@lo:400:kworker.0 00000100:00100000:3.0:1788625238.796284:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625238.796392:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206182912:0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.796707:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625238.796736:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206183424:0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.796761:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625238.796777:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206183936:0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.796800:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625238.796819:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788625238.796824:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206183040:0@lo:400:kworker.0 00000100:00100000:3.0:1788625238.796990:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206182656 00000100:00100000:3.0:1788625238.796999:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206182656 00000100:00100000:3.0:1788625238.797121:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788625238.797131:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206182656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625238.797180:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206182656:12345-0@lo:400:kworker.0 Request processed in 52us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625238.797256:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788625238.797505:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625238.797649:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206183552:0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.797690:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625238.797699:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206183808:0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.797733:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206183936 00000100:00100000:3.0:1788625238.797739:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625238.797740:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206183936 00000100:00100000:1.0:1788625238.797781:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206183808 00000100:00100000:1.0:1788625238.797784:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206183808 00000100:00100000:3.0:1788625238.797789:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206182656:0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.797830:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788625238.797832:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625238.797840:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206183936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625238.797844:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206183680:0@lo:400:kworker.0 00000100:00100000:3.0:1788625238.797877:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625238.797907:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206183936:12345-0@lo:400:kworker.0 Request processed in 69us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625238.797910:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206183168 00000100:00100000:3.0:1788625238.797915:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206183168 00000100:00100000:1.0:1788625238.797916:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788625238.797936:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788625238.797945:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206183808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625238.797946:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206182912 00000100:00100000:3.0:1788625238.797950:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206182912 00000100:00100000:3.0:1788625238.797973:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788625238.797981:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206183168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.797990:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206183808:12345-0@lo:400:kworker.0 Request processed in 46us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625238.797997:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788625238.798032:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206183168:12345-0@lo:400:kworker.0 Request processed in 50us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625238.798035:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206183936:0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.798060:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206183808:0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.798069:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206183168:0@lo:400:kworker.0 00000100:00080000:1.0:1788625238.798094:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625238.798106:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206182784 00000100:00100000:1.0:1788625238.798109:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206182784 00000100:00100000:3.0:1788625238.798123:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788625238.798129:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206183296 00000100:00100000:1.0:1788625238.798132:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206183296 00000100:00100000:3.0:1788625238.798144:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788625238.798155:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206182912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.798155:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206183424 00000100:00100000:1.0:1788625238.798159:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206183424 00000100:00100000:1.0:1788625238.798176:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206183040 00000100:00100000:1.0:1788625238.798178:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206183040 00000100:00100000:1.0:1788625238.798190:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206183552 00000100:00100000:1.0:1788625238.798192:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206183552 00000100:00100000:1.0:1788625238.798201:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206183680 00000100:00100000:1.0:1788625238.798203:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206183680 00000100:00100000:1.0:1788625238.798214:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788625238.798220:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206182784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.798643:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206182784:12345-0@lo:400:kworker.0 Request processed in 421us (2692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625238.798650:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788625238.798665:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788625238.798672:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206183296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625238.798731:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206182912:12345-0@lo:400:kworker.0 Request processed in 578us (2306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625238.798739:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788625238.798776:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206182912:0@lo:400:kworker.0 00000100:00100000:3.0:1788625238.798838:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625238.799059:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206183296:12345-0@lo:400:kworker.0 Request processed in 387us (3054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625238.799066:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788625238.799077:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185121664 00000100:00100000:1.0:1788625238.799081:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185121664 00000100:00100000:1.0:1788625238.799104:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788625238.799109:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206183424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.799157:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206183424:12345-0@lo:400:kworker.0 Request processed in 47us (2395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625238.799163:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788625238.799173:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788625238.799180:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206183040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.799207:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206183040:12345-0@lo:400:kworker.0 Request processed in 28us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625238.799213:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788625238.799223:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788625238.799229:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206183552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.799283:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206183552:12345-0@lo:400:kworker.0 Request processed in 53us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625238.799290:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788625238.799311:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788625238.799317:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206183680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.799347:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206183680:12345-0@lo:400:kworker.0 Request processed in 30us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625238.799353:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788625238.799365:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 54 00000100:00100000:1.0:1788625238.799649:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+29:11156:x1875509185121664:12345-192.168.204.14@tcp:101:lfs.0 00000100:00100000:3.0:1788625238.799665:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206183040:0@lo:400:kworker.0 00010000:00010000:1.0:1788625238.799666:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788625238.799698:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206183552:0@lo:400:kworker.0 00010000:00010000:1.0:1788625238.799703:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882044000/0x2d2e3b3f34a7a6f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e0d0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788625238.799716:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8edf80 x1875509206183424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625238.799725:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206183424:0@lo:400:kworker.0 00000100:00080000:2.0:1788625238.799941:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788625238.799946:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788625238.800091:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882044000/0x2d2e3b3f34a7a6f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0d0 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.800107:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998882044000/0x2d2e3b3f34a7a6f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0d0 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.800126:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:1.0:1788625238.800129:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625238.800132:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882044000, rc 0) 00000100:00100000:1.0:1788625238.800218:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+30:11156:x1875509185121664:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 574us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625238.800226:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 54 00010000:00080000:1.0:1788625238.800262:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99887f8efb80 x1875509206183680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625238.800273:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206183680:0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.800294:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206182784:0@lo:400:kworker.0 00000100:00100000:1.0:1788625238.800304:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206183296:0@lo:400:kworker.0 00000100:00100000:0.0:1788625238.804317:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625238.804473:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185121920 00000100:00100000:3.0:1788625238.804483:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185121920 00000100:00100000:2.0:1788625238.805148:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:2.0:1788625238.805165:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844c52050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+30:11156:x1875509185121920:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:2.0:1788625238.805436:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844c52050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+31:11156:x1875509185121920:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 277us (1130us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788625238.805444:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:0.0:1788625238.908044:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625238.908214:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185122176 00000100:00100000:2.0:1788625238.908240:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185122176 00000100:00100000:2.0:1788625238.908321:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 55 00000100:00100000:2.0:1788625238.908332:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+31:11166:x1875509185122176:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625238.908359:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625238.908381:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a6fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e0d7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625238.908488:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788625238.908646:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a6fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0d7 expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.908663:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:2.0:1788625238.908666:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625238.908672:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a6fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0d7 expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.908698:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7e00, rc 0) 00000100:00100000:2.0:1788625238.908757:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+32:11166:x1875509185122176:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 427us (724us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1788625238.908765:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 55 00000100:00100000:3.0:1788625238.922211:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625238.922938:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185122304 00000100:00100000:2.0:1788625238.922951:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185122304 00000100:00100000:2.0:1788625238.923032:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00100000:2.0:1788625238.923043:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+32:11166:x1875509185122304:12345-192.168.204.14@tcp:34:lfs.0 00010000:00010000:2.0:1788625238.923131:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a70a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923152:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a70a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923183:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a70a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923196:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a711 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923204:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a711 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923210:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a711 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923323:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a718 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923343:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a718 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923351:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a718 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625238.923476:0:9824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a718 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923491:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a70a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923497:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a70a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923504:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a70a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923559:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625238.923563:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a70a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923571:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a70a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923587:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625238.923589:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625238.923593:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a70a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923599:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a70a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923612:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a711 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923618:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a711 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923623:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a711 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923627:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625238.923629:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a711 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923635:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a711 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923653:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988749c9f00) 00010000:00010000:2.0:1788625238.923656:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625238.923659:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a711 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923665:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a711 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923684:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a718 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923691:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a718 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923697:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a718 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923703:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625238.923706:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a718 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923712:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a718 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923719:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625238.923721:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625238.923724:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a718 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625238.923728:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a718 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625238.924045:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+32:11166:x1875509185122304:12345-192.168.204.14@tcp:34:lfs.0 Request processed in 1002us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625238.924054:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00100000:1.0:1788625238.931100:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625238.931184:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185122560 00000100:00100000:2.0:1788625238.931197:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185122560 00000100:00100000:2.0:1788625238.931258:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:2.0:1788625238.931270:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+32:11166:x1875509185122560:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:2.0:1788625238.931560:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+33:11166:x1875509185122560:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 290us (468us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788625238.931568:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:0.0:1788625238.978276:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625238.978388:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185122816 00000100:00100000:1.0:1788625238.978400:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185122816 00000100:00100000:1.0:1788625238.978467:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00100000:1.0:1788625238.978477:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+33:11169:x1875509185122816:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625238.978507:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625238.978559:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7a71f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e0de expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.978639:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7a726 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.978655:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7a726 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.978668:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7a726 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.978692:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a72d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.978700:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a72d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.978732:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a72d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.978887:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7a734 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979260:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7a734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979272:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7a734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625238.979313:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788625238.979514:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7a726 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979576:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7a726 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979583:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7a726 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979588:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882044800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625238.979612:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7a726 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979633:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7a726 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979652:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:1.0:1788625238.979655:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625238.979660:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7a726 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979702:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7a726 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979718:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a72d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979724:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a72d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979730:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a72d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979736:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882045e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625238.979739:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a72d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979745:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a72d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979753:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988749c9f00) 00010000:00010000:1.0:1788625238.979756:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625238.979759:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a72d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979769:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7a72d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.979811:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7a71f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0de expref: 36 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.980003:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7a734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0de expref: 35 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625238.980020:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:1.0:1788625238.980023:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625238.980044:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5000, rc 0) 00000100:00100000:1.0:1788625238.980159:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+35:11169:x1875509185122816:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 1684us (1893us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788625238.980168:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00100000:3.0:1788625238.989478:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625238.993021:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185122944 00000100:00100000:0.0:1788625238.993036:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185122944 00000100:00100000:0.0:1788625238.993114:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 58 00000100:00100000:0.0:1788625238.993125:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+35:11169:x1875509185122944:12345-192.168.204.14@tcp:54:lfs.0 00010000:00010000:0.0:1788625238.993198:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a742 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.993216:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a742 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.993228:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a742 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.993330:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a742 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.993338:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a742 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.993345:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a742 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.994414:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625238.994786:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a742 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.994797:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a742 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.994936:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:0.0:1788625238.994940:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788625238.994946:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a742 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625238.994953:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a742 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625238.995059:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+35:11169:x1875509185122944:12345-192.168.204.14@tcp:54:lfs.0 Request processed in 1933us (5589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625238.995069:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 58 00000100:00100000:0.0:1788625239.001690:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625239.001868:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185123200 00000100:00100000:2.0:1788625239.001879:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185123200 00000100:00100000:2.0:1788625239.002551:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00100000:2.0:1788625239.002565:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+35:11169:x1875509185123200:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:2.0:1788625239.002831:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+36:11169:x1875509185123200:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 269us (1159us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788625239.002839:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 11 00010000:00010000:1.0:1788625239.116188:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625239.292688:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625239.293090:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185123456 00000100:00100000:2.0:1788625239.293165:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185123456 00000100:00100000:2.0:1788625239.293278:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 59 00000100:00100000:2.0:1788625239.293289:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+36:11200:x1875509185123456:12345-192.168.204.14@tcp:101:cat.0 00010000:00010000:2.0:1788625239.293313:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625239.293335:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a749 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e0e5 expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.294087:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a750 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.295061:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.295078:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625239.295095:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788625239.295266:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a749 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0e5 expref: 39 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.295286:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a750 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0e5 expref: 38 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.295295:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625239.295299:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625239.295302:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7200, rc 0) 00000100:00100000:2.0:1788625239.295382:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+38:11200:x1875509185123456:12345-192.168.204.14@tcp:101:cat.0 Request processed in 2094us (2714us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788625239.295392:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 59 00000100:00100000:3.0:1788625239.304603:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625239.304654:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625239.304999:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185123840 00000100:00100000:1.0:1788625239.305010:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185123840 00000100:00100000:0.0:1788625239.305013:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185123712 00000100:00100000:0.0:1788625239.305020:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185123712 00000100:00100000:1.0:1788625239.305081:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00100000:0.0:1788625239.305086:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 4 00000100:00100000:1.0:1788625239.305095:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+39:11200:x1875509185123840:12345-192.168.204.14@tcp:35:cat.0 00000100:00100000:1.0:1788625239.305782:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+40:11200:x1875509185123840:12345-192.168.204.14@tcp:35:cat.0 Request processed in 687us (1123us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1788625239.305791:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00100000:0.0:1788625239.306229:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+39:2393:x1875509185123712:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625239.306246:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625239.306271:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a750 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0e5 expref: 39 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.306289:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:0.0:1788625239.306308:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625239.306345:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+38:2393:x1875509185123712:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 1251us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625239.306354:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 4 00000100:00100000:0.0:1788625239.307989:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625239.308175:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206184192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625239.308221:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998860804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206184064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625239.308246:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625239.308265:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625239.308348:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206184064 00000100:00100000:2.0:1788625239.308356:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206184064 00000100:00100000:2.0:1788625239.308402:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788625239.308512:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206184192 00000100:00100000:3.0:1788625239.308534:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206184192 00000100:00100000:3.0:1788625239.308566:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788625239.308575:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206184192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788625239.308605:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1788625239.308658:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206184192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625239.308665:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788625239.308931:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206184064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788625239.308963:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625239.309107:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206184064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625239.309119:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788625239.309301:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998860804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206184064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625239.309435:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206184320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625239.309475:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625239.309706:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206184320 00000100:00100000:2.0:1788625239.309712:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206184320 00000100:00100000:2.0:1788625239.309746:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788625239.309754:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206184320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625239.309767:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625239.309838:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887cb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206184192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625239.309993:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206184320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 239us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625239.310001:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788625239.310061:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206184320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625239.392787:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625239.392904:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185124096 00000100:00100000:1.0:1788625239.392914:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185124096 00000100:00100000:1.0:1788625239.392978:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 60 00000100:00100000:1.0:1788625239.392988:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+38:11206:x1875509185124096:12345-192.168.204.14@tcp:101:dd.0 00010000:00010000:1.0:1788625239.393016:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625239.393019:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788625239.393061:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a6b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0bb expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625239.393083:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:1.0:1788625239.393088:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625239.393110:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7a75e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e0ec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625239.393218:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625239.393232:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7a734 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0de expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625239.393240:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625239.393270:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7a734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0de expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625239.393284:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7a734 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0de expref: 38 pid: 6511 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625239.393298:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206184448:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625239.393409:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625239.395954:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206184448:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625239.395984:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625239.396567:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625239.396695:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185124224 00000100:00100000:2.0:1788625239.396702:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185124224 00010000:00010000:2.0:1788625239.396743:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7a734 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0de expref: 39 pid: 6511 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625239.396782:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 55 00000100:00100000:2.0:1788625239.396791:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+39:2394:x1875509185124224:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625239.396806:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625239.396813:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7a734 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0de expref: 39 pid: 6511 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.396825:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7a734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0de expref: 39 pid: 6511 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.396861:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7a734 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0de expref: 39 pid: 6511 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.396876:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625239.396881:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.396891:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.396899:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.396927:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625239.396983:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+38:2394:x1875509185124224:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 193us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625239.396991:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 55 00010000:00010000:3.0:1788625239.397049:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.397057:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625239.397075:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788625239.397231:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7a75e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ec expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.397245:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ec expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.397259:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:3.0:1788625239.397262:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788625239.397264:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4a00, rc 0) 00000100:00100000:3.0:1788625239.397291:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+38:11206:x1875509185124096:12345-192.168.204.14@tcp:101:dd.0 Request processed in 4306us (4515us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788625239.397298:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 60 00000100:00100000:0.0:1788625239.403988:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625239.404102:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185124352 00000100:00100000:2.0:1788625239.404117:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185124352 00000100:00100000:2.0:1788625239.404186:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 61 00000100:00100000:2.0:1788625239.404197:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+38:11206:x1875509185124352:12345-192.168.204.14@tcp:101:dd.0 00010000:00010000:2.0:1788625239.404222:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625239.404242:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a773 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e0f3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.404277:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a77a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.404312:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a77a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.404325:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a77a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.404450:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a773 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0f3 expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.404469:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a77a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0f3 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.404480:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625239.404483:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788625239.404487:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7c00, rc 0) 00000100:00100000:2.0:1788625239.404802:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+39:11206:x1875509185124352:12345-192.168.204.14@tcp:101:dd.0 Request processed in 512us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625239.404811:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 61 00000100:00100000:0.0:1788625239.409138:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625239.409217:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185124608 00000100:00100000:2.0:1788625239.409228:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185124608 00000100:00100000:2.0:1788625239.409294:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 62 00000100:00100000:2.0:1788625239.409305:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+39:11206:x1875509185124608:12345-192.168.204.14@tcp:36:dd.0 00010000:00010000:2.0:1788625239.409575:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7a781 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.409595:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7a781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.409627:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7a781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625239.409690:0:9824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1788625239.409713:0:9824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a335daa5 reply state 00000000b86b9547 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7a781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.409726:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7a781 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.409874:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625239.409878:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625239.409883:0:9824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625239.409996:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:11206:x1875509185124608:12345-192.168.204.14@tcp:36:dd.0 Request processed in 692us (868us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788625239.410004:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 62 00000020:00080000:2.0:1788625239.410009:0:9824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788625239.663748:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625239.663908:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185124736 00000100:00100000:3.0:1788625239.663920:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185124736 00000100:00100000:3.0:1788625239.663986:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 63 00000100:00100000:3.0:1788625239.663996:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:11220:x1875509185124736:12345-192.168.204.14@tcp:101:stat.0 00010000:00010000:3.0:1788625239.664024:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625239.664046:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a788 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e0fa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.664115:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a78f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.664131:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a78f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.664422:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a78f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.664440:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a796 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.664449:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a796 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.664478:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a796 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.664870:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a79d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.664884:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ec expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.664893:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a79d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.664932:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ec expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.664949:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ec expref: 43 pid: 6511 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625239.664964:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998860805500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206184576:192.168.204.14@tcp:104: 00000100:00100000:3.0:1788625239.665119:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988607fd900 going to sleep for 11 seconds 00000100:00100000:3.0:1788625239.671859:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998860805500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206184576:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625239.671892:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a79d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625239.676244:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625239.676361:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185124992 00000100:00100000:2.0:1788625239.676371:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185124992 00000100:00100000:2.0:1788625239.676439:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 13 00000100:00100000:2.0:1788625239.676450:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+44:6161:x1875509185124992:12345-192.168.204.14@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788625239.676846:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+45:6161:x1875509185124992:12345-192.168.204.14@tcp:35:ldlm_bl.0 Request processed in 397us (611us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788625239.676854:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 13 00000100:00100000:1.0:1788625239.680604:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625239.681075:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185125120 00000100:00100000:3.0:1788625239.681085:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185125120 00010000:00010000:3.0:1788625239.681128:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ec expref: 45 pid: 6511 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625239.681195:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00100000:3.0:1788625239.681205:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+45:2394:x1875509185125120:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625239.681220:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625239.681227:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ec expref: 45 pid: 6511 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.681240:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ec expref: 45 pid: 6511 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.681262:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a765 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0ec expref: 45 pid: 6511 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.681279:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:3.0:1788625239.681284:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a79d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.681295:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a79d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.681303:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a79d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625239.681334:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625239.681386:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+44:2394:x1875509185125120:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 182us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625239.681394:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 56 00010000:00010000:2.0:1788625239.682068:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a79d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682078:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a79d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625239.682326:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788625239.682332:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625239.682377:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a79d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682392:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a79d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682404:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a78f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682412:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a78f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682418:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a78f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682424:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625239.682428:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a78f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682436:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a78f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682447:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625239.682450:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625239.682454:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a78f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682459:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a78f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682511:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a796 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682554:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a796 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682560:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a796 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682566:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625239.682569:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a796 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682575:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a796 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682584:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988749c9f00) 00010000:00010000:2.0:1788625239.682586:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625239.682589:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a796 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682594:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a796 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682652:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a788 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0fa expref: 44 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682677:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a79d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0fa expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.682948:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625239.682952:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625239.682955:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683400, rc 0) 00000100:00100000:2.0:1788625239.683002:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+43:11220:x1875509185124736:12345-192.168.204.14@tcp:101:stat.0 Request processed in 19007us (19265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625239.683010:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 63 00000100:00100000:0.0:1788625239.762269:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625239.762481:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185125376 00000100:00100000:2.0:1788625239.762492:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185125376 00000100:00100000:2.0:1788625239.762624:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:2.0:1788625239.762634:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+43:11226:x1875509185125376:12345-192.168.204.14@tcp:36:truncate.0 00010000:00010000:2.0:1788625239.762700:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625239.762727:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a79d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0fa expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.762749:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625239.762756:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625239.762929:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a7a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.762943:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.762953:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625239.762991:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1788625239.763012:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f0d06e7 reply state 00000000d6caf7ea transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.763039:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a7a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.763045:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625239.763048:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625239.763050:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625239.763178:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+45:11226:x1875509185125376:12345-192.168.204.14@tcp:36:truncate.0 Request processed in 545us (918us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788625239.763186:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 64 00000020:00080000:2.0:1788625239.763191:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788625239.895051:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625239.895168:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185125504 00000100:00100000:0.0:1788625239.895179:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185125504 00000100:00100000:0.0:1788625239.895251:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:0.0:1788625239.895262:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+45:11240:x1875509185125504:12345-192.168.204.14@tcp:101:stat.0 00010000:00010000:0.0:1788625239.895299:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625239.895323:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a7ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e101 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895407:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a7b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895424:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a7b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895438:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a7b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895449:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a7b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895469:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895476:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895613:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a7c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895623:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895629:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625239.895678:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788625239.895683:0:11318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625239.895717:0:11318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895731:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895739:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a7b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895745:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a7b2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895751:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a7b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895767:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625239.895771:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a7b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895778:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a7b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895790:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:0.0:1788625239.895793:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625239.895798:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a7b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895804:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a7b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895819:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895825:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a7b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895831:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895836:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625239.895838:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895844:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a7b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895862:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988749c9f00) 00010000:00010000:0.0:1788625239.895865:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625239.895868:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a7b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895874:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a7b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895902:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a7ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e101 expref: 47 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895915:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e101 expref: 46 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625239.895923:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:0.0:1788625239.895937:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625239.895941:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995c00, rc 0) 00000100:00100000:0.0:1788625239.896014:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+46:11240:x1875509185125504:12345-192.168.204.14@tcp:101:stat.0 Request processed in 754us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625239.896022:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:1.0:1788625239.967453:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625239.973182:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185125760 00000100:00100000:2.0:1788625239.973198:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185125760 00000100:00100000:2.0:1788625239.973330:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 66 00000100:00100000:2.0:1788625239.973341:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+46:11250:x1875509185125760:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625239.973361:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625239.973382:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e108 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625239.973485:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788625239.973614:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e108 expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.973629:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:2.0:1788625239.973632:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625239.973638:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e108 expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625239.973685:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6000, rc 0) 00000100:00100000:2.0:1788625239.973782:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+47:11250:x1875509185125760:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 443us (6340us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788625239.973790:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 66 00000100:00100000:3.0:1788625239.980008:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625239.984426:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185126016 00000100:00100000:1.0:1788625239.984443:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185126016 00000100:00100000:1.0:1788625239.984638:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00100000:1.0:1788625239.984650:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+47:11250:x1875509185126016:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:1.0:1788625239.985037:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+48:11250:x1875509185126016:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 387us (5036us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1788625239.985045:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00100000:1.0:1788625240.069452:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625240.069545:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185126272 00000100:00100000:2.0:1788625240.069555:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185126272 00000100:00100000:2.0:1788625240.069628:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 67 00000100:00100000:2.0:1788625240.069641:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+48:11256:x1875509185126272:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625240.069675:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625240.069697:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7d5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e10f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.069815:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.069967:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a7c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e101 expref: 49 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.069976:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.070014:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e101 expref: 49 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.070027:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a7c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e101 expref: 49 pid: 11318 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625240.070060:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aeea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206184704:192.168.204.14@tcp:104: 00000100:00080000:1.0:1788625240.070245:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625240.070407:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887cabef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625240.075742:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aeea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206184704:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625240.075772:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625240.076513:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625240.076738:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185126400 00000100:00100000:0.0:1788625240.076746:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185126400 00010000:00010000:0.0:1788625240.076855:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a7c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e101 expref: 50 pid: 11318 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625240.076899:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00100000:0.0:1788625240.076918:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+50:2393:x1875509185126400:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625240.076947:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625240.076954:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a7c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e101 expref: 50 pid: 11318 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625240.076967:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e101 expref: 50 pid: 11318 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625240.076988:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a7c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e101 expref: 50 pid: 11318 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625240.077006:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:0.0:1788625240.077010:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625240.077020:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625240.077027:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625240.077115:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625240.077172:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+49:2393:x1875509185126400:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 263us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625240.077180:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 57 00010000:00010000:1.0:1788625240.077412:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.077420:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625240.077502:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788625240.077691:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e10f expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.077710:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e10f expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.077732:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:1.0:1788625240.077735:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788625240.077738:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7800, rc 0) 00000100:00100000:1.0:1788625240.077781:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+49:11256:x1875509185126272:12345-192.168.204.14@tcp:101:bash.0 Request processed in 8144us (8339us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788625240.077788:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 67 00000100:00100000:1.0:1788625240.080650:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625240.080919:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185126656 00000100:00100000:2.0:1788625240.080930:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185126656 00000100:00100000:2.0:1788625240.080996:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 68 00000100:00100000:2.0:1788625240.081007:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+49:11256:x1875509185126656:12345-192.168.204.14@tcp:36:bash.0 00010000:00010000:2.0:1788625240.081231:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a7ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.081250:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a7ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.081262:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a7ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625240.081309:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788625240.081332:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009eb794d6 reply state 000000004e5e6f5e transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a7ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.081346:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a7ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.081354:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625240.081356:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625240.081375:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625240.081512:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+52:11256:x1875509185126656:12345-192.168.204.14@tcp:36:bash.0 Request processed in 506us (870us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788625240.081552:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 68 00000020:00080000:2.0:1788625240.081558:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788625240.093328:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625240.094109:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185126784 00000100:00100000:2.0:1788625240.094123:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185126784 00000100:00100000:2.0:1788625240.094305:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 69 00000100:00100000:2.0:1788625240.094318:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+52:11256:x1875509185126784:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625240.094353:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625240.094376:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a7f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e116 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.094473:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.094489:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e10f expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.094499:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7f8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.094561:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e10f expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.094576:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e10f expref: 53 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625240.094601:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aeea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206184832:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625240.094789:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887cabef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625240.101297:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aeea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206184832:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625240.101331:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625240.102098:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625240.102218:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185126912 00000100:00100000:1.0:1788625240.102226:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185126912 00010000:00010000:1.0:1788625240.102266:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e10f expref: 54 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625240.102303:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 58 00000100:00100000:1.0:1788625240.102313:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+54:2393:x1875509185126912:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625240.103129:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625240.103142:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e10f expref: 54 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.103159:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e10f expref: 54 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.103182:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a7dc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e10f expref: 54 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.103199:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:1.0:1788625240.103221:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.103232:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.103240:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7f8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.103278:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625240.103342:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+53:2393:x1875509185126912:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 1029us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625240.103351:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 58 00010000:00010000:2.0:1788625240.103557:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.103566:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625240.103636:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788625240.103642:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625240.103672:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.103704:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a7f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e116 expref: 53 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.103720:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e116 expref: 52 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.103727:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625240.103730:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625240.103732:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6000, rc 0) 00000100:00100000:2.0:1788625240.103759:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+52:11256:x1875509185126784:12345-192.168.204.14@tcp:101:bash.0 Request processed in 9446us (10442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625240.103767:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 69 00000100:00100000:0.0:1788625240.108825:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625240.108945:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185127168 00000100:00100000:1.0:1788625240.108955:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185127168 00000100:00100000:1.0:1788625240.109132:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00100000:1.0:1788625240.109145:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844c50450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+52:11256:x1875509185127168:12345-192.168.204.14@tcp:35:bash.0 00000100:00100000:1.0:1788625240.109399:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844c50450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+53:11256:x1875509185127168:12345-192.168.204.14@tcp:35:bash.0 Request processed in 256us (585us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788625240.109408:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 15 00010000:00010000:2.0:1788625240.139787:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625240.196451:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625240.199253:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185127424 00000100:00100000:1.0:1788625240.199270:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185127424 00000100:00100000:1.0:1788625240.199352:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 70 00000100:00100000:1.0:1788625240.199363:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+53:11267:x1875509185127424:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625240.199391:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625240.199415:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7a7ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e11d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625240.199544:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788625240.199674:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7a7ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e11d expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.199690:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:1.0:1788625240.199693:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625240.199700:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7a7ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e11d expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.199714:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4400, rc 0) 00000100:00100000:1.0:1788625240.199790:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+54:11267:x1875509185127424:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 430us (3351us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1788625240.199799:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 70 00000100:00100000:0.0:1788625240.206838:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625240.211559:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185127552 00000100:00100000:3.0:1788625240.211575:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185127552 00000100:00100000:2.0:1788625240.218014:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 71 00000100:00100000:2.0:1788625240.218027:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+54:11267:x1875509185127552:12345-192.168.204.14@tcp:34:lfs.0 00010000:00010000:2.0:1788625240.218108:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a80d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.218125:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a80d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.218136:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a80d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.218147:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a814 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.218154:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.218160:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.218233:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a81b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.218242:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a81b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.218249:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a81b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625240.218297:0:9824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a81b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.218868:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a80d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.218890:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a80d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.218896:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a80d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.218902:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625240.218907:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a80d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.218913:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a80d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.218925:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625240.218928:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625240.218933:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a80d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.218939:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a80d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.219102:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.219109:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a814 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.219114:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a814 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.219120:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625240.219130:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a814 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.219137:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a814 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.219146:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988749c9f00) 00010000:00010000:2.0:1788625240.219149:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625240.219153:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a814 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.219163:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a814 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.219174:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a81b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.219180:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a81b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.219185:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a81b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.219189:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625240.219192:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a81b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.219198:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a81b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.219205:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625240.219207:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625240.219216:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a81b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.219223:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a81b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625240.219376:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+54:11267:x1875509185127552:12345-192.168.204.14@tcp:34:lfs.0 Request processed in 1348us (12545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625240.219385:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 71 00000100:00100000:0.0:1788625240.229667:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625240.229807:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185127808 00000100:00100000:1.0:1788625240.229818:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185127808 00000100:00100000:1.0:1788625240.229886:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:1.0:1788625240.229896:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+54:11267:x1875509185127808:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:1.0:1788625240.230736:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+55:11267:x1875509185127808:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 835us (1089us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788625240.230746:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:3.0:1788625240.282876:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625240.283410:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185128064 00000100:00100000:2.0:1788625240.283421:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185128064 00000100:00100000:2.0:1788625240.284819:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 72 00000100:00100000:2.0:1788625240.284837:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+55:11270:x1875509185128064:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625240.284866:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625240.284889:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a822 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e124 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.284966:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a829 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.284981:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a829 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.284992:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a829 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285003:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a830 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285011:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285037:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285147:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a837 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285156:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285164:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625240.285173:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788625240.285268:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a829 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285277:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a829 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285284:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a829 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285289:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625240.285293:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a829 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285302:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a829 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285313:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625240.285316:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625240.285328:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a829 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285335:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a829 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285349:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285356:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a830 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285361:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a830 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285366:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625240.285369:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a830 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285374:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a830 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285382:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988749c9f00) 00010000:00010000:2.0:1788625240.285385:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625240.285388:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a830 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285393:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a830 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285431:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a822 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e124 expref: 58 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285456:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a837 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e124 expref: 57 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.285464:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625240.285466:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625240.285469:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6200, rc 0) 00000100:00100000:2.0:1788625240.285569:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+57:11270:x1875509185128064:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 739us (2752us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788625240.285577:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 72 00000100:00100000:0.0:1788625240.291412:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625240.291511:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625240.291667:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185128192 00000100:00100000:2.0:1788625240.291680:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185128192 00000100:00100000:2.0:1788625240.291849:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 73 00000100:00100000:2.0:1788625240.291861:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+57:11270:x1875509185128192:12345-192.168.204.14@tcp:54:lfs.0 00010000:00010000:2.0:1788625240.291934:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a845 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.291953:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.291965:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.291999:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.292006:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a845 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.292032:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a845 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.292037:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625240.292042:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a845 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.292050:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a845 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.292063:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625240.292066:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625240.292071:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a845 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.292078:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a845 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625240.292206:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+57:11270:x1875509185128192:12345-192.168.204.14@tcp:54:lfs.0 Request processed in 347us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625240.292214:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 73 00000100:00100000:3.0:1788625240.293125:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185128320 00000100:00100000:3.0:1788625240.293145:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185128320 00000100:00100000:3.0:1788625240.293200:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 5 00000100:00100000:3.0:1788625240.293209:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+57:2393:x1875509185128320:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625240.293223:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625240.293250:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a837 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e124 expref: 57 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625240.293265:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:3.0:1788625240.293269:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625240.293312:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+56:2393:x1875509185128320:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 104us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625240.293319:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 5 00000100:00100000:0.0:1788625240.298369:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625240.298566:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185128576 00000100:00100000:1.0:1788625240.298577:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185128576 00000100:00100000:1.0:1788625240.298635:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:1.0:1788625240.298661:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+56:11270:x1875509185128576:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:1.0:1788625240.299066:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+57:11270:x1875509185128576:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 420us (705us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788625240.299074:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:0.0:1788625240.475907:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625240.476098:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185128832 00000100:00100000:2.0:1788625240.476109:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185128832 00000100:00100000:2.0:1788625240.476179:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 74 00000100:00100000:2.0:1788625240.476189:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+57:11288:x1875509185128832:12345-192.168.204.14@tcp:101:cat.0 00010000:00010000:2.0:1788625240.476212:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625240.476233:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a84c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e12b expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.476368:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a853 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.476384:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a853 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.476397:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a853 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625240.476407:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788625240.476544:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a84c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e12b expref: 60 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.476710:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a853 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e12b expref: 59 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.476718:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625240.476721:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788625240.476725:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6e00, rc 0) 00000100:00100000:2.0:1788625240.476793:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:11288:x1875509185128832:12345-192.168.204.14@tcp:101:cat.0 Request processed in 605us (894us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1788625240.476800:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 74 00000100:00100000:0.0:1788625240.514984:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625240.515148:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185128960 00000100:00100000:2.0:1788625240.515160:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185128960 00000100:00100000:2.0:1788625240.515223:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 75 00000100:00100000:2.0:1788625240.515234:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:11289:x1875509185128960:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625240.515260:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625240.515299:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a861 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e132 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.515387:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a868 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.515404:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.515417:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625240.515463:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788625240.515467:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625240.515486:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.515514:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a861 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e132 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.515574:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a868 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e132 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.515583:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625240.515586:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625240.515590:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7000, rc 0) 00000100:00100000:2.0:1788625240.515662:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:11289:x1875509185128960:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 430us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625240.515669:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 75 00000100:00100000:0.0:1788625240.523214:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625240.523380:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185129344 00000100:00100000:1.0:1788625240.523393:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185129344 00000100:00100000:1.0:1788625240.523456:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:1.0:1788625240.523468:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:11289:x1875509185129344:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:1.0:1788625240.524058:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11289:x1875509185129344:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 590us (850us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788625240.524067:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:3.0:1788625240.527195:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625240.527455:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185129472 00000100:00100000:2.0:1788625240.527481:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185129472 00000100:00100000:2.0:1788625240.527618:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:2.0:1788625240.527636:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11289:x1875509185129472:12345-192.168.204.14@tcp:103:lfs.0 00010000:00010000:2.0:1788625240.527667:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788625240.527692:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a7f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e116 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.527737:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a853 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e12b expref: 60 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.527752:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882044000/0x2d2e3b3f34a7a6f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0d0 expref: 59 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.527763:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625240.527775:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625240.527898:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:11289:x1875509185129472:12345-192.168.204.14@tcp:103:lfs.0 Request processed in 270us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625240.527906:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:0.0:1788625240.539358:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625240.540460:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185129600 00000100:00100000:2.0:1788625240.540476:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185129600 00000100:00100000:2.0:1788625240.540592:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 76 00000100:00100000:2.0:1788625240.540604:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:11289:x1875509185129600:12345-192.168.204.14@tcp:58:lfs.0 00010000:00010000:2.0:1788625240.540744:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a86f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.540763:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a86f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625240.540792:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a86f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625240.541044:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625240.541183:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788625240.541267:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788625240.541372:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:11289:x1875509185129600:12345-192.168.204.14@tcp:58:lfs.0 Request processed in 770us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625240.541382:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 76 00000100:00100000:0.0:1788625240.560263:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625240.560367:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185129728 00000100:00100000:1.0:1788625240.560378:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185129728 00000100:00100000:1.0:1788625240.560446:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 77 00000100:00100000:1.0:1788625240.560457:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:11291:x1875509185129728:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625240.560478:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625240.560502:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7a876 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e139 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.560736:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7a87d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.560753:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7a87d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.560763:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7a87d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.560775:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7a884 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.560782:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7a884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.560804:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7a884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.560875:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7a88b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.560885:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7a88b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561259:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7a88b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625240.561307:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788625240.561310:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625240.561329:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7a88b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561341:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7a88b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561350:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7a87d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561357:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7a87d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561363:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7a87d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561369:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625240.561374:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7a87d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561391:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7a87d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561404:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:1.0:1788625240.561407:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625240.561413:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7a87d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561420:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7a87d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561433:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7a884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561439:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7a884 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561445:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7a884 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561450:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625240.561453:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7a884 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561459:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7a884 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561466:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988749c9f00) 00010000:00010000:1.0:1788625240.561469:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625240.561472:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7a884 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561488:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7a884 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561816:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7a876 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e139 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561834:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7a88b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e139 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625240.561842:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:1.0:1788625240.561844:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625240.561847:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5600, rc 0) 00000100:00100000:1.0:1788625240.561921:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:11291:x1875509185129728:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 1466us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625240.561929:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 77 00000100:00100000:3.0:1788625241.086199:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.086262:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625241.086582:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185129856 00000100:00100000:2.0:1788625241.086596:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185129856 00000100:00100000:3.0:1788625241.086735:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 379 00000100:00100000:3.0:1788625241.086748:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2392:x1875509185129856:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625241.086749:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185129984 00000100:00100000:1.0:1788625241.086756:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185129984 00000100:00100000:1.0:1788625241.086816:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 274 00000100:00100000:1.0:1788625241.086826:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2392:x1875509185129984:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625241.086849:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2392:x1875509185129856:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 103us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.086858:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 379 00000100:00100000:1.0:1788625241.086873:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2392:x1875509185129984:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 48us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625241.086881:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 274 00000100:00080000:1.0:1788625241.086909:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625241.092706:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625241.092841:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625241.092861:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185130240 00000100:00100000:0.0:1788625241.092873:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625241.092875:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185130240 00000100:00080000:0.0:1788625241.092987:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625241.093033:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185130368 00000100:00100000:1.0:1788625241.093038:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185130368 00000100:00080000:0.0:1788625241.093357:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625241.093582:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185130112 00000100:00100000:3.0:1788625241.093589:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185130112 00000100:00100000:1.0:1788625241.093645:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 275 00000100:00100000:1.0:1788625241.093660:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185130240:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625241.093666:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 103 00000100:00100000:3.0:1788625241.093677:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2391:x1875509185130112:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625241.093772:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 276 00000100:00100000:2.0:1788625241.093784:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185130368:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625241.093861:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2391:x1875509185130112:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 185us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.093869:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 103 00000100:00080000:3.0:1788625241.093895:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625241.097595:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185130240:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 3920us (4884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625241.097617:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 275 00000100:00100000:2.0:1788625241.097681:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185130368:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 3896us (4802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625241.097692:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 276 00010000:00010000:0.0:1788625241.164177:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625241.291796:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788625241.291805:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788625241.291835:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788625241.291842:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788625241.291969:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998860804e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1875509206184960:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788625241.292065:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c8c7480 going to sleep for 11 seconds 00000040:00080000:2.0:1788625241.292128:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788625241.295254:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998860804e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1875509206184960:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788625241.298885:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625241.306683:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185130496 00000100:00100000:2.0:1788625241.306701:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185130496 00000100:00100000:2.0:1788625241.306767:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 78 00000100:00100000:2.0:1788625241.306778:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:11303:x1875509185130496:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788625241.306810:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788625241.306943:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:11303:x1875509185130496:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 Request processed in 166us (8066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625241.306950:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 78 00000100:00100000:1.0:1788625241.311377:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625241.311465:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185130624 00000100:00100000:2.0:1788625241.311482:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185130624 00000100:00100000:2.0:1788625241.311982:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 79 00000100:00100000:2.0:1788625241.311996:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:11303:x1875509185130624:12345-192.168.204.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788625241.312071:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a892 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312090:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a892 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312102:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a892 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312118:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a899 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312125:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a899 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312132:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a899 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312157:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a8a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312166:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312172:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625241.312217:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788625241.312221:0:9824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625241.312241:0:9824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312254:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a892 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312261:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a892 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312267:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a892 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312273:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625241.312277:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a892 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312285:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a892 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312297:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998743548200) 00010000:00010000:2.0:1788625241.312300:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625241.312306:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a892 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312312:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a892 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312324:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a899 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312330:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a899 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312335:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a899 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312349:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625241.312352:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a899 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312358:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a899 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312367:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9988625be200) 00010000:00010000:2.0:1788625241.312371:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625241.312374:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a899 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312380:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a899 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312399:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312405:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a8a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312411:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a8a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312416:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625241.312419:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a8a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312426:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a8a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312446:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625241.312449:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625241.312453:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a8a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.312458:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a8a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625241.312585:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:11303:x1875509185130624:12345-192.168.204.14@tcp:34:lhsmtool_posix.0 Request processed in 592us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625241.312594:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 79 00000100:00100000:1.0:1788625241.315346:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625241.315436:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185130880 00000100:00100000:2.0:1788625241.315448:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185130880 00000100:00100000:2.0:1788625241.317456:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 80 00000100:00100000:2.0:1788625241.317477:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:11303:x1875509185130880:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625241.317505:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625241.317548:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a8a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e140 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.317713:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a8ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.317729:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a8ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.317742:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a8ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625241.317753:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788625241.317848:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a8ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.317857:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a8ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.317865:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a8ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.317871:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625241.317876:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a8ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.317885:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a8ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.317900:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625241.317903:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625241.317909:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a8ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.317915:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a8ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.318096:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a8a7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e140 expref: 61 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.318110:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998743548200) 00010000:00010000:2.0:1788625241.318112:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625241.318117:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a8a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e140 expref: 61 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.318143:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7800, rc 0) 00000100:00100000:2.0:1788625241.318215:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:11303:x1875509185130880:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 746us (2879us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1788625241.318234:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 80 00000100:00100000:0.0:1788625241.321473:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.321711:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185131008 00000100:00100000:3.0:1788625241.321720:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185131008 00000100:00100000:3.0:1788625241.321774:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 81 00000100:00100000:3.0:1788625241.321785:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:11303:x1875509185131008:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788625241.321820:0:6511:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788625241.321944:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:11303:x1875509185131008:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 Request processed in 161us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.321952:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 81 00000100:00100000:1.0:1788625241.326949:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.328376:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185131264 00000100:00100000:3.0:1788625241.328390:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185131264 00000100:00100000:3.0:1788625241.328457:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 82 00000100:00100000:3.0:1788625241.328467:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:11303:x1875509185131264:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625241.328488:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625241.328491:0:9824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788625241.328538:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7a868 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e132 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.328772:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:3.0:1788625241.328778:0:9824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625241.328794:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a8bc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e147 expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788625241.329167:0:9824:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788625241.329326:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a8c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.329342:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.329355:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.329405:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a8bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e147 expref: 62 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.329421:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a8c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e147 expref: 61 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.329429:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9988606b3300) 00010000:00010000:3.0:1788625241.329432:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625241.329434:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683400, rc 0) 00000100:00100000:3.0:1788625241.329510:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11303:x1875509185131264:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 1045us (2571us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788625241.329563:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 82 00000100:00100000:0.0:1788625241.333054:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.333245:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185131520 00000100:00100000:3.0:1788625241.333256:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185131520 00000100:00100000:3.0:1788625241.333383:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 83 00000100:00100000:3.0:1788625241.333395:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11303:x1875509185131520:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788625241.333453:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625241.333481:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7a8c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e147 expref: 61 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333498:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9988606b3300) 00010000:00010000:3.0:1788625241.333538:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625241.333562:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a8d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333576:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a8d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333585:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a8d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333650:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a8d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x299c92ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333659:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a8d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x299c92ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333666:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a8d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x299c92ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333723:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a8d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333731:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a8d1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333738:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a8d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333745:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625241.333859:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a8d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333869:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a8d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333880:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:3.0:1788625241.333883:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625241.333887:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a8d1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333894:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7a8d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333905:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a8d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x299c92ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333911:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a8d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x299c92ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333918:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a8d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x299c92ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333929:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625241.333932:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a8d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x299c92ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333939:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a8d8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x299c92ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333952:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x299c92ed (ffff9988606b3000) 00010000:00010000:3.0:1788625241.333955:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625241.333957:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a8d8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x299c92ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.333963:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7a8d8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x299c92ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625241.334053:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:11303:x1875509185131520:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 659us (1007us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788625241.334060:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 83 00000100:00100000:1.0:1788625241.337649:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.338731:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185131648 00000100:00100000:3.0:1788625241.338743:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185131648 00000100:00100000:3.0:1788625241.338934:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 84 00000100:00100000:3.0:1788625241.338946:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:11303:x1875509185131648:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625241.338966:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625241.338992:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a8df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e14e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.339040:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a8e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.339065:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.339087:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.339732:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a8df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e14e expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.339875:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e14e expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.339887:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9988606b3500) 00010000:00010000:3.0:1788625241.339890:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788625241.339894:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683c00, rc 0) 00000100:00100000:3.0:1788625241.339972:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11303:x1875509185131648:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 1028us (2332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.339982:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 84 00000040:00080000:1.0:1788625241.344337:0:14200:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788625241.344345:0:14200:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788625241.344370:0:14200:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788625241.344375:0:14200:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788625241.344571:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625241.344602:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185131904 00000100:00100000:0.0:1788625241.344613:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185131904 00000100:00100000:0.0:1788625241.344677:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 85 00000100:00100000:0.0:1788625241.344688:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11303:x1875509185131904:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788625241.344770:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a8ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.344787:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a8ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.344798:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a8ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625241.344954:0:9824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788625241.344963:0:9824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362452445317ns, next at 363452443103ns, rc = 0 00000004:00010000:0.0:1788625241.345006:0:9824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec061fa5 reply state 0000000074e03570 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a8ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.345019:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a8ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.345027:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9988606b3500) 00010000:00010000:0.0:1788625241.345030:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788625241.345033:0:9824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788625241.345120:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:11303:x1875509185131904:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 432us (554us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788625241.345127:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 85 00000100:00100000:0.0:1788625241.347646:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.347683:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185132032 00000100:00100000:3.0:1788625241.347694:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185132032 00000100:00100000:3.0:1788625241.347751:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 86 00000100:00100000:3.0:1788625241.347761:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:11303:x1875509185132032:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625241.347785:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625241.347806:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a8f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e155 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.347879:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a8f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e155 expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.347895:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a8f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e155 expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.347915:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9988606b3500) 00010000:00010000:3.0:1788625241.347918:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788625241.347922:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682200, rc 0) 00000100:00100000:3.0:1788625241.347985:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+64:11303:x1875509185132032:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 225us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.347994:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 86 00000100:00100000:0.0:1788625241.351176:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.351271:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185132160 00000100:00100000:3.0:1788625241.351281:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185132160 00000100:00100000:2.0:1788625241.351461:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 32 00000100:00100000:2.0:1788625241.351470:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875509185132160:12345-192.168.204.14@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788625241.351506:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp t0 exp 0000000000000000 cur 362 last 0 00000020:00000080:2.0:1788625241.351565:0:8425:0:(genops.c:1385:class_connect()) connect: client 1338b3dc-3f02-4b26-a9aa-7a14f6033224, cookie 0x2d2e3b3f34a7a8fb 00002000:00100000:2.0:1788625241.351580:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1338b3dc-3f02-4b26-a9aa-7a14f6033224/ffff998744148000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788625241.351927:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788625241.352004:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788625241.352034:0:8425:0:(import.c:65:import_set_state_nolock()) ffff998744149800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625241.352104:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2390:x1875509185132160:12345-192.168.204.14@tcp:8:lhsmtool_posix.0 Request processed in 633us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625241.352112:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 32 00000100:00100000:0.0:1788625241.354794:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625241.354968:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185132288 00000100:00100000:1.0:1788625241.354979:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185132288 00000100:00100000:1.0:1788625241.355054:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 33 00000100:00100000:1.0:1788625241.355066:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:0:x1875509185132288:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788625241.355131:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788625241.361262:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1788625241.361275:0:9503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000100:00100000:0.0:1788625241.361899:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:0:x1875509185132288:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 Request processed in 6830us (7105us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788625241.361912:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 33 00000100:00100000:0.0:1788625241.365278:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625241.365435:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185132544 00000100:00100000:2.0:1788625241.365447:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185132544 00000100:00100000:2.0:1788625241.365554:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:2.0:1788625241.365566:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+64:11303:x1875509185132544:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788625241.365813:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:11303:x1875509185132544:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 249us (545us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1788625241.365821:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:2.0:1788625241.368975:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.369060:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185132800 00000100:00100000:3.0:1788625241.369071:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185132800 00000100:00100000:3.0:1788625241.369132:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 87 00000100:00100000:3.0:1788625241.369142:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:11303:x1875509185132800:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788625241.369489:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:11303:x1875509185132800:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 347us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.369496:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 87 00000100:00100000:0.0:1788625241.375793:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625241.380840:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185132928 00000100:00100000:2.0:1788625241.380857:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185132928 00000100:00100000:2.0:1788625241.380932:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 88 00000100:00100000:2.0:1788625241.380943:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:11303:x1875509185132928:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625241.380964:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625241.380986:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a902 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e15c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.381068:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a909 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.381087:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a909 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.381101:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a909 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625241.381157:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625241.381177:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a909 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.381202:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a902 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e15c expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.381218:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a909 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e15c expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.381227:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9988606b3500) 00010000:00010000:2.0:1788625241.381230:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788625241.381233:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7200, rc 0) 00000100:00100000:2.0:1788625241.381312:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+66:11303:x1875509185132928:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 371us (5529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625241.381320:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 88 00000100:00100000:2.0:1788625241.388276:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.388394:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185133056 00000100:00100000:3.0:1788625241.388403:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185133056 00000100:00100000:3.0:1788625241.388551:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 34 00000100:00100000:3.0:1788625241.388566:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185133056:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625241.388583:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625241.388602:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a910 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e163 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788625241.388638:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c4158, blocks: 0x0 00010000:00010000:3.0:1788625241.388658:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=362s v=(0 0) 00010000:00010000:3.0:1788625241.388663:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625241.388673:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a910 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e163 expref: 6 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.388702:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a910 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e163 expref: 6 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.388716:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682e00, rc 0) 00000100:00100000:3.0:1788625241.388847:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185133056:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 281us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.388854:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 34 00000100:00100000:0.0:1788625241.400301:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.400438:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185133312 00000100:00100000:3.0:1788625241.400448:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185133312 00000100:00100000:3.0:1788625241.400531:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 89 00000100:00100000:3.0:1788625241.400542:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+66:11303:x1875509185133312:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788625241.400673:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+66:11303:x1875509185133312:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 132us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.400681:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 89 00000100:00100000:0.0:1788625241.406052:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625241.407416:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185133440 00000100:00100000:1.0:1788625241.407431:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185133440 00000100:00100000:1.0:1788625241.407497:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 35 00000100:00100000:1.0:1788625241.407508:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:11303:x1875509185133440:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625241.407676:0:8868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625241.407697:0:8868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7a917 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e16a expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.407744:0:8868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a910 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e163 expref: 7 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.407754:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625241.407758:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625241.407826:0:8868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7a917 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e16a expref: 7 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.407864:0:8868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a910 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e163 expref: 7 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.407878:0:8868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a910 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e163 expref: 7 pid: 8423 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625241.407904:0:8868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8868:1875509206185088:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625241.408001:0:8868:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742e1f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788625241.414654:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625241.414703:0:8868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8868:1875509206185088:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625241.414740:0:8868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7a917 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e16a expref: 7 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.414773:0:8868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4200, rc 0) 00000100:00100000:3.0:1788625241.414775:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185133568 00000100:00100000:3.0:1788625241.414782:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185133568 00010000:00010000:3.0:1788625241.414813:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a910 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e163 expref: 8 pid: 8423 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625241.414832:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:11303:x1875509185133440:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 7327us (8791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625241.414840:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 35 00000100:00100000:3.0:1788625241.414844:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 59 00000100:00100000:3.0:1788625241.414854:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2394:x1875509185133568:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625241.414867:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625241.414901:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a910 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e163 expref: 7 pid: 8423 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.414915:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a910 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e163 expref: 7 pid: 8423 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.414938:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a910 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e163 expref: 7 pid: 8423 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.414951:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625241.414955:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625241.414963:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7a917 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e16a expref: 6 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.414974:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7a917 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e16a expref: 6 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.415009:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7a917 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e16a expref: 6 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625241.415030:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998860804e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1875509206185216:192.168.204.14@tcp:105: 00000100:00100000:3.0:1788625241.415082:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866feacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625241.420183:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998860804e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1875509206185216:192.168.204.14@tcp:105: 00010000:00010000:3.0:1788625241.420208:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625241.420271:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185133568:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 5418us (5626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.420283:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 59 00000100:00100000:0.0:1788625241.424355:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625241.424571:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185133696 00000100:00100000:1.0:1788625241.424581:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185133696 00002000:00100000:1.0:1788625241.424643:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9987439c4e00 x1875509185133696/t0(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:52/0 lens 504/0 e 0 to 0 dl 1788625252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625241.424655:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9987439c4e00 with x1875509185133696 ext(0->8) 00002000:00010000:1.0:1788625241.424661:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9987439c4e00 00000100:00100000:1.0:1788625241.424691:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:1.0:1788625241.424700:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185133696:12345-192.168.204.14@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788625241.425890:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2393:x1875509185133696:12345-192.168.204.14@tcp:4:lhsmtool_posix.0 Request processed in 1184us (1539us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788625241.425901:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 0 00002000:00100000:1.0:1788625241.425910:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9987439c4e00 x1875509185133696/t4294967303(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:52/0 lens 504/448 e 0 to 0 dl 1788625252 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625241.425920:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9987439c4e00 with x1875509185133696 ext(0->8) 00002000:00010000:1.0:1788625241.425926:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9987439c4e00 00000100:00100000:2.0:1788625241.429280:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625241.429444:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185133824 00000100:00100000:1.0:1788625241.429454:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185133824 00000100:00100000:1.0:1788625241.429731:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 90 00000100:00100000:1.0:1788625241.429744:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+66:11303:x1875509185133824:12345-192.168.204.14@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788625241.432748:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1788625241.432771:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:3.0:1788625241.432804:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a631 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432815:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a631 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432823:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a631 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432828:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170800 already unused, calling callback (ffffffffc19e84f0) 00000004:00080000:0.0:1788625241.432829:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788625241.432833:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a631 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432842:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a631 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788625241.432847:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff998742e1f6c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788625241.432851:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998866faea00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff998742e1f240 00000020:00080000:0.0:1788625241.432853:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998866fae600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff998743a02800 00010000:00010000:3.0:1788625241.432858:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9988749c9900) 00010000:00010000:3.0:1788625241.432861:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625241.432866:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a631 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432884:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7a631 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432904:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a638 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432911:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a638 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432917:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a638 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432922:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625241.432925:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a638 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432931:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a638 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432940:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:3.0:1788625241.432942:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625241.432945:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a638 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432951:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7a638 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432969:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a677 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432976:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a677 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432988:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a677 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.432994:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625241.432997:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a677 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433003:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a677 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433011:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988749c9f00) 00010000:00010000:3.0:1788625241.433014:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625241.433017:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a677 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433022:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a677 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433043:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7a781 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433050:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7a781 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433056:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7a781 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433061:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625241.433063:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7a781 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433078:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7a781 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433086:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:3.0:1788625241.433089:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625241.433092:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7a781 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433097:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7a781 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433107:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a7a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433112:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a7a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433117:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a7a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433121:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625241.433124:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a7a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433130:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a7a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433136:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:3.0:1788625241.433139:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625241.433141:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a7a4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625241.433141:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788625241.433155:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7a7a4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625241.433158:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206185344:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788625241.433166:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a7ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433171:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a7ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433176:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a7ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433180:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625241.433182:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a7ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433187:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a7ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433193:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:3.0:1788625241.433195:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625241.433198:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a7ea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433202:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7a7ea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433211:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a8ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433216:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a8ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433226:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a8ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625241.433230:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625241.433231:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625241.433234:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a8ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433240:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a8ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433247:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9988606b3500) 00010000:00010000:3.0:1788625241.433249:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788625241.433252:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a8ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.433256:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a8ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788625241.433272:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1788625241.433275:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206185344 00000100:00100000:1.0:1788625241.433281:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206185344 00000100:00100000:1.0:1788625241.433330:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788625241.433344:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206185344:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1788625241.433411:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00002000:00010000:1.0:1788625241.433431:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788625241.433435:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788625240 00002000:00010000:1.0:1788625241.433437:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788625241.433439:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788625240 -> 1788625240 00002000:00010000:1.0:1788625241.433442:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788625241.433488:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1875509206185344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 145us (257us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788625241.433495:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788625241.433543:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625241.433667:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:11303:x1875509185133824:12345-192.168.204.14@tcp:44:lhsmtool_posix.0 Request processed in 3925us (4395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625241.433676:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 90 00000100:00100000:0.0:1788625241.434166:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625241.434177:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206185472:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788625241.434210:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625241.434327:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206185472 00000100:00100000:0.0:1788625241.434333:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206185472 00000100:00100000:0.0:1788625241.434368:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788625241.434375:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1875509206185472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788625241.434393:0:8424:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1788625241.434419:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9c4155, atime: 0x6a9c4155, ctime: 0x6a9c4155, blocks: 0x8 00010000:00010000:0.0:1788625241.434426:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a91e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.434441:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=362s v=(0 0) 00010000:00010000:0.0:1788625241.434446:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625241.434452:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a91e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.434468:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a91e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.434478:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a91e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.434495:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a91e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.434511:0:8424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625241.434798:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625241.434807:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a91e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.434816:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625241.434820:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a91e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.434830:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a91e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.434913:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a91e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.434932:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dec43314/0x2d2e3b3f34a7a91e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.434950:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625241.434952:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625241.434954:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788625241.434962:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625241.435035:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3637:x1875509206185472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 659us (822us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788625241.435042:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:1.0:1788625241.435185:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99887f8a5180/2, rc 0, transno 4294967302 00000100:00100000:1.0:1788625241.435192:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206185472:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788625241.435356:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99887f8ec700/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788625241.435362:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206185344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788625241.436816:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.436887:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185133952 00000100:00100000:3.0:1788625241.436895:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185133952 00000100:00100000:3.0:1788625241.436945:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 38 00000100:00100000:3.0:1788625241.436954:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2394:x1875509185133952:12345-192.168.204.14@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788625241.438901:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1788625241.438912:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1788625241.439094:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185133952:12345-192.168.204.14@tcp:16:lhsmtool_posix.0 Request processed in 2137us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.439111:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 38 00000100:00100000:1.0:1788625241.443026:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625241.443908:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185134208 00000100:00100000:2.0:1788625241.443920:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185134208 00000100:00100000:2.0:1788625241.443984:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 91 00000100:00100000:2.0:1788625241.443994:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:11303:x1875509185134208:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788625241.444050:0:11318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625241.444078:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7a909 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e15c expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.444094:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9988606b3500) 00010000:00010000:2.0:1788625241.444100:0:11318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625241.444127:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a925 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.444139:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a925 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.444149:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a925 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625241.444265:0:11318:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000893af765 reply state 00000000c87241ea transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a925 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.444285:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a925 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.444292:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9988606b3500) 00010000:00010000:2.0:1788625241.444294:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625241.444297:0:11318:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625241.444398:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+15:11303:x1875509185134208:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 405us (1384us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1788625241.444406:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 91 00000100:00100000:2.0:1788625241.447689:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625241.447781:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185134336 00000100:00100000:1.0:1788625241.447789:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185134336 00000100:00100000:1.0:1788625241.448082:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 39 00000100:00100000:1.0:1788625241.448096:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185134336:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788625241.448330:0:8868:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788625241.448334:0:8868:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788625240 -> 1788625239 00002000:00010000:1.0:1788625241.448336:0:8868:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788625237 00002000:00010000:1.0:1788625241.448338:0:8868:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788625240 -> 1788625239 00002000:00010000:1.0:1788625241.448340:0:8868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788625241.448401:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2394:x1875509185134336:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 Request processed in 308us (722us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788625241.448409:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 39 00000100:00100000:0.0:1788625241.452509:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625241.452592:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185134592 00000100:00100000:0.0:1788625241.452616:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185134592 00000100:00100000:0.0:1788625241.452713:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 92 00000100:00100000:0.0:1788625241.452731:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+15:11303:x1875509185134592:12345-192.168.204.14@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788625241.453271:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a92c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.453699:0:9824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a8e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e14e expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.453715:0:9824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a92c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.453819:0:9824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e14e expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.453840:0:9824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a8e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e14e expref: 15 pid: 6511 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625241.453878:0:9824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9824:1875509206185600:192.168.204.14@tcp:104: 00000100:00100000:0.0:1788625241.454017:0:9824:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743550540 going to sleep for 11 seconds 00000100:00100000:0.0:1788625241.457198:0:9824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9824:1875509206185600:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625241.457238:0:9824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a92c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625241.457611:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.457886:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185134720 00000100:00100000:3.0:1788625241.457897:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185134720 00010000:00010000:3.0:1788625241.457946:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a8e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e14e expref: 16 pid: 6511 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625241.458432:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 60 00000100:00100000:3.0:1788625241.458446:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:2394:x1875509185134720:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625241.458468:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625241.458477:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a8e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e14e expref: 16 pid: 6511 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.458495:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e14e expref: 16 pid: 6511 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.458556:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a8e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e14e expref: 16 pid: 6511 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.458581:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9988606b3500) 00010000:00010000:3.0:1788625241.458588:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a92c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.458602:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a92c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.459277:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a92c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.459343:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625241.459431:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+15:2394:x1875509185134720:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 985us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.459441:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 60 00010000:00010000:3.0:1788625241.459481:0:9824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a92c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.459490:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a92c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.459562:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a92c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.459569:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a92c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.459576:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a92c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.459582:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625241.459587:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a92c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.459595:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a92c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.459607:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9988606b3500) 00010000:00010000:3.0:1788625241.459610:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788625241.459613:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a92c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.459643:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a92c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625241.459695:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:11303:x1875509185134592:12345-192.168.204.14@tcp:55:lhsmtool_posix.0 Request processed in 6972us (7202us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788625241.459704:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 92 00000100:00100000:2.0:1788625241.464697:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.464886:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185134848 00000100:00100000:3.0:1788625241.464901:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185134848 00000100:00100000:3.0:1788625241.464978:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 40 00000100:00100000:3.0:1788625241.464993:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185134848:12345-192.168.204.14@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788625241.465050:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a933 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.465076:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7a917 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e16a expref: 7 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.465087:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625241.465093:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625241.465099:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a933 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.465409:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7a917 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e16a expref: 7 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.465427:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7a917 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e16a expref: 7 pid: 8868 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625241.465466:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998860804e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1875509206185728:192.168.204.14@tcp:104: 00000100:00100000:3.0:1788625241.465638:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866feacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625241.470412:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998860804e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1875509206185728:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625241.470456:0:8423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a933 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625241.471082:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.471288:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185134976 00000100:00100000:3.0:1788625241.471299:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185134976 00010000:00010000:3.0:1788625241.471347:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7a917 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e16a expref: 8 pid: 8868 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625241.471406:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 61 00000100:00100000:3.0:1788625241.471418:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2394:x1875509185134976:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625241.471437:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625241.471465:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7a917 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e16a expref: 8 pid: 8868 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.471480:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7a917 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e16a expref: 8 pid: 8868 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.471512:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7a917 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e16a expref: 8 pid: 8868 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.471555:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625241.471579:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625241.471587:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a933 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.471600:0:9513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a933 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.471651:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625241.471732:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2394:x1875509185134976:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 314us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.471742:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 61 00010000:00010000:2.0:1788625241.471887:0:8423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a933 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.471904:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a933 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.471937:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a933 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.471946:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a933 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.471956:0:8423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a933 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.471984:0:8423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625241.471989:0:8423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a933 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.471999:0:8423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a933 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.472028:0:8423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a933 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.472038:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7a933 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625241.472166:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185134848:12345-192.168.204.14@tcp:1:lhsmtool_posix.0 Request processed in 7174us (7473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625241.472181:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 40 00000100:00100000:2.0:1788625241.477126:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625241.477431:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185135232 00000100:00100000:0.0:1788625241.477451:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185135232 00000100:00100000:0.0:1788625241.477582:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 93 00000100:00100000:0.0:1788625241.477606:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:11303:x1875509185135232:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788625241.477901:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a93a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.477925:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a77a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0f3 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.477936:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a93a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.477984:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a77a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0f3 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.478004:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a77a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0f3 expref: 14 pid: 6512 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625241.478044:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206185856:192.168.204.14@tcp:104: 00000100:00100000:0.0:1788625241.478187:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743550540 going to sleep for 11 seconds 00000100:00100000:1.0:1788625241.482745:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625241.482981:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206185856:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625241.483010:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a93a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625241.483342:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185135360 00000100:00100000:3.0:1788625241.483359:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185135360 00010000:00010000:3.0:1788625241.483417:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a77a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0f3 expref: 15 pid: 6512 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625241.483480:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 62 00000100:00100000:3.0:1788625241.483491:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+15:2394:x1875509185135360:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625241.483511:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625241.483542:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a77a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0f3 expref: 15 pid: 6512 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.483561:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a77a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0f3 expref: 15 pid: 6512 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.483592:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7a77a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e0f3 expref: 15 pid: 6512 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.483646:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:3.0:1788625241.483652:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a93a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.483664:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a93a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.483673:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a93a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.483705:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625241.483788:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:2394:x1875509185135360:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 298us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.483797:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 62 00010000:00010000:0.0:1788625241.485185:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a93a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.485202:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a93a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.485594:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a941 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.485612:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a8f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e155 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.485631:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a941 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.485672:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a8f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e155 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625241.485751:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a8f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e155 expref: 14 pid: 6513 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625241.485767:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206185984:192.168.204.14@tcp:104: 00000100:00100000:0.0:1788625241.485889:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987435506c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625241.490049:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206185984:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625241.490080:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a941 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625241.493024:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.493220:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185135488 00000100:00100000:3.0:1788625241.493230:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185135488 00010000:00010000:3.0:1788625241.493272:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a8f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e155 expref: 15 pid: 6513 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625241.493317:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 63 00000100:00100000:3.0:1788625241.493327:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+15:2393:x1875509185135488:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625241.493341:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625241.493348:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a8f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e155 expref: 15 pid: 6513 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.493362:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a8f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e155 expref: 15 pid: 6513 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.493404:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a8f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e155 expref: 15 pid: 6513 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.493420:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9988606b3500) 00010000:00010000:3.0:1788625241.493426:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a941 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.493436:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a941 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.493457:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a941 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.493492:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625241.493595:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:2393:x1875509185135488:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 267us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.493602:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 63 00010000:00010000:2.0:1788625241.493838:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a941 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.493847:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a941 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625241.493956:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1788625241.494062:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1788625241.494096:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1788625241.494172:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1875509206186112:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788625241.494226:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625241.494262:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625241.495122:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206186112 00000100:00100000:3.0:1788625241.495131:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206186112 00000100:00100000:3.0:1788625241.495220:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788625241.495229:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6511:x1875509206186112:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788625241.495345:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6511:x1875509206186112:12345-0@lo:1000:mdt00_000.0 Request processed in 117us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.495352:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788625241.495419:0:6511:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788625241.495425:0:6511:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99887f8ec700, transno 4294967304 00000100:00100000:2.0:1788625241.495482:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1875509206186112:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788625241.495642:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788625241.495714:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1875509206186240:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788625241.495761:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625241.495789:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437dacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625241.495859:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206186240 00000100:00100000:0.0:1788625241.495865:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206186240 00000100:00100000:0.0:1788625241.495902:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788625241.495911:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6511:x1875509206186240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788625241.496024:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6511:x1875509206186240:12345-0@lo:1000:mdt00_000.0 Request processed in 113us (261us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788625241.496032:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788625241.496071:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1875509206186240:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788625241.496113:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a941 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496122:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a941 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496129:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a941 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496135:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625241.496140:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a941 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496148:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a941 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496175:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9988606b3500) 00010000:00010000:2.0:1788625241.496178:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625241.496184:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a941 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496191:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a941 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496220:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a86f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496227:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a86f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496233:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a86f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496238:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625241.496241:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a86f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496247:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a86f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496255:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625241.496257:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625241.496260:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a86f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496267:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a86f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496314:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a948 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496401:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7a88b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e139 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496410:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a948 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496437:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7a88b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e139 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.496451:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7a88b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e139 expref: 17 pid: 6512 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625241.496464:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206186368:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625241.496549:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437dacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625241.499719:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206186368:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625241.499753:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a948 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625241.500434:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625241.504030:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185135616 00000100:00100000:3.0:1788625241.504045:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185135616 00010000:00010000:3.0:1788625241.504096:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7a88b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e139 expref: 18 pid: 6512 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625241.504159:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:3.0:1788625241.504169:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:2393:x1875509185135616:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625241.504183:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625241.504189:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7a88b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e139 expref: 18 pid: 6512 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.504201:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7a88b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e139 expref: 18 pid: 6512 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.504225:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7a88b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e139 expref: 18 pid: 6512 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.504241:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:3.0:1788625241.504246:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a948 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.504256:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a948 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.504263:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a948 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625241.504298:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625241.504351:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+17:2393:x1875509185135616:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 184us (3921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625241.504359:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 64 00010000:00010000:2.0:1788625241.504496:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a948 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.504506:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a948 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.504535:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a948 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.504543:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a948 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.504689:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a948 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.504695:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625241.504700:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a948 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.504708:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a948 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.504717:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625241.504720:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625241.504724:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a948 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.504731:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7800/0x2d2e3b3f34a7a948 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.504750:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a93a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.504756:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a93a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.504762:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a93a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.504768:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625241.504770:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a93a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.504786:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a93a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.504796:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7700) 00010000:00010000:2.0:1788625241.504798:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788625241.504801:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a93a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.504808:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a93a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625241.504953:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:11303:x1875509185135232:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 27360us (27836us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788625241.504963:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 93 00000020:00080000:2.0:1788625241.504968:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788625241.506105:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788625241.506112:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788625241.506137:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788625241.506143:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788625241.510404:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625241.510452:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185135872 00000100:00100000:1.0:1788625241.510463:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185135872 00000100:00100000:1.0:1788625241.510604:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:1.0:1788625241.510618:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:11303:x1875509185135872:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788625241.510914:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788625241.510947:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1788625241.510980:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7a94f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.510997:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7a94f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.511009:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7a94f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.511017:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7a94f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.511024:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7a94f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.511036:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7a94f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625241.511060:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788625241.511147:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:11303:x1875509185135872:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 533us (751us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788625241.511154:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 20 00000020:00080000:1.0:1788625241.511159:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788625241.511223:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625241.511230:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7a94f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.511238:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625241.511243:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7a94f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.511250:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7a94f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.511267:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9988606b3500) 00010000:00010000:2.0:1788625241.511270:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788625241.511282:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7a94f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.511289:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7a94f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625241.511301:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625241.511302:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625241.511304:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625242.189471:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625242.891913:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625242.893129:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744186680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206186496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625242.893204:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625242.893447:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206186496 00000100:00100000:0.0:1788625242.893457:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206186496 00000100:00100000:0.0:1788625242.893918:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788625242.893929:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206186496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625242.893968:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788625242.894087:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206186496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 160us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625242.894095:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788625242.894207:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744186680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206186496:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788625243.069476:0:14252:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788625243.069486:0:14252:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788625243.070388:0:14252:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788625243.070398:0:14252:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788625243.180154:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.180868:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185136128 00000100:00100000:2.0:1788625243.180881:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185136128 00000100:00100000:2.0:1788625243.180979:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 94 00000100:00100000:2.0:1788625243.180992:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:11321:x1875509185136128:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625243.181022:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625243.181051:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a956 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e171 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.181173:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a95d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.181201:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a95d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.181217:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a95d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625243.181230:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788625243.181346:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7a956 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e171 expref: 21 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.181365:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a95d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e171 expref: 20 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.181373:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625243.181376:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788625243.181379:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6000, rc 0) 00000100:00100000:2.0:1788625243.181443:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+20:11321:x1875509185136128:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 454us (1300us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788625243.181451:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 94 00000100:00080000:0.0:1788625243.181896:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625243.194510:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625243.195976:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185136256 00000100:00100000:1.0:1788625243.195988:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185136256 00000100:00100000:1.0:1788625243.196746:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 95 00000100:00100000:1.0:1788625243.196761:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+20:11321:x1875509185136256:12345-192.168.204.14@tcp:34:lfs.0 00010000:00010000:1.0:1788625243.197396:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a96b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197416:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a96b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197430:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a96b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197467:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a972 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197475:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197483:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197584:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7a979 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197603:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7a979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197620:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7a979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625243.197677:0:9824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7a979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197691:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a96b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197698:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a96b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197704:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a96b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197709:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625243.197714:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a96b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197721:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a96b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197732:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:1.0:1788625243.197736:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625243.197741:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a96b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197747:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7a96b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197758:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197764:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a972 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197776:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a972 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197781:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625243.197784:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a972 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197791:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a972 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197799:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9987410b7600) 00010000:00010000:1.0:1788625243.197812:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625243.197816:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a972 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197822:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a972 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197837:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7a979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197843:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7a979 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197848:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7a979 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197854:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625243.197856:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7a979 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197873:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7a979 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197880:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9987410b7c00) 00010000:00010000:1.0:1788625243.197883:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625243.197885:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7a979 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.197891:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7a979 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625243.197998:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+20:11321:x1875509185136256:12345-192.168.204.14@tcp:34:lfs.0 Request processed in 1239us (3496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625243.198008:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 95 00010000:00010000:0.0:1788625243.212810:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625243.242564:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625243.242645:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185136512 00000100:00100000:0.0:1788625243.242654:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185136512 00000100:00100000:0.0:1788625243.242714:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 96 00000100:00100000:0.0:1788625243.242724:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+20:11324:x1875509185136512:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:0.0:1788625243.242759:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625243.242781:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a980 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e178 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.242848:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a987 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.242864:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a987 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.242876:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a987 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.242893:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a98e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.242901:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a98e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.242907:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a98e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243020:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a995 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243029:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243036:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625243.243046:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788625243.243128:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a987 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243136:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a987 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243142:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a987 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243147:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625243.243152:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a987 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243160:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a987 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243172:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:0.0:1788625243.243174:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625243.243179:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a987 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243184:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a987 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243200:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a98e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243207:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a98e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243213:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a98e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243219:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625243.243233:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a98e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243240:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a98e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243248:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988749c3600) 00010000:00010000:0.0:1788625243.243250:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625243.243253:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a98e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243259:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a98e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243301:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a980 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e178 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243315:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a995 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e178 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.243323:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:0.0:1788625243.243325:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625243.243328:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994600, rc 0) 00000100:00100000:0.0:1788625243.243393:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:11324:x1875509185136512:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 670us (836us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788625243.243401:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 96 00000100:00100000:2.0:1788625243.248300:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625243.248353:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185136640 00000100:00100000:0.0:1788625243.248476:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185136640 00000100:00100000:3.0:1788625243.248634:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 97 00000100:00100000:3.0:1788625243.248647:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:11324:x1875509185136640:12345-192.168.204.14@tcp:54:lfs.0 00010000:00010000:3.0:1788625243.248727:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a9a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.248748:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.248761:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.248798:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.248805:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a9a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.248812:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a9a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.248818:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625243.248822:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a9a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.248830:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a9a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.248841:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:3.0:1788625243.248844:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788625243.248848:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a9a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.248866:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a9a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625243.248941:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:11324:x1875509185136640:12345-192.168.204.14@tcp:54:lfs.0 Request processed in 297us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625243.248950:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 97 00000100:00100000:3.0:1788625243.253481:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.253579:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185136896 00000100:00100000:2.0:1788625243.253598:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185136896 00000100:00100000:2.0:1788625243.253655:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:2.0:1788625243.253681:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844c50850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:11324:x1875509185136896:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:2.0:1788625243.253914:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844c50850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+23:11324:x1875509185136896:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 233us (441us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788625243.253922:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:2.0:1788625243.291942:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625243.292100:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185137152 00000100:00100000:1.0:1788625243.292111:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185137152 00000100:00100000:1.0:1788625243.292172:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 98 00000100:00100000:1.0:1788625243.292183:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+23:10841:x1875509185137152:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:1.0:1788625243.292209:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625243.292231:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7a9aa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e17f expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.292339:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.292355:0:9824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a995 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e178 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.292364:0:9824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.292413:0:9824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a995 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e178 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.292427:0:9824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a995 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e178 expref: 24 pid: 6511 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625243.292441:0:9824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744185c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9824:1875509206186624:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625243.292580:0:9824:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842a87000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625243.295502:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625243.295823:0:9824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744185c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9824:1875509206186624:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625243.295851:0:9824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625243.298812:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185137280 00000100:00100000:0.0:1788625243.299238:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185137280 00010000:00010000:1.0:1788625243.300696:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a995 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e178 expref: 25 pid: 6511 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625243.300875:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:1.0:1788625243.301025:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+25:2393:x1875509185137280:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625243.301043:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625243.301050:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a995 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e178 expref: 25 pid: 6511 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.301065:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a995 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e178 expref: 25 pid: 6511 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.301086:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7a995 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e178 expref: 25 pid: 6511 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.301131:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:1.0:1788625243.301137:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.301146:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.301155:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.301201:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625243.301272:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:2393:x1875509185137280:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 379us (5772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625243.301280:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 65 00010000:00010000:2.0:1788625243.301296:0:9824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.301308:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625243.301339:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788625243.301492:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7a9aa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e17f expref: 25 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.301509:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e17f expref: 24 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.301549:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:2.0:1788625243.301552:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788625243.301555:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4c00, rc 0) 00000100:00100000:2.0:1788625243.301584:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:10841:x1875509185137152:12345-192.168.204.14@tcp:101:bash.0 Request processed in 9403us (9653us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1788625243.301604:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 98 00000100:00100000:3.0:1788625243.306933:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625243.307082:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185137408 00000100:00100000:0.0:1788625243.307093:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185137408 00000100:00100000:0.0:1788625243.307156:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 99 00000100:00100000:0.0:1788625243.307166:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:10841:x1875509185137408:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:0.0:1788625243.307189:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625243.307210:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a9bf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e186 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.307246:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a9c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.307261:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.307273:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.307630:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a9bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e186 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.307720:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a9c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e186 expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.307730:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:0.0:1788625243.307732:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788625243.307736:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994800, rc 0) 00000100:00100000:0.0:1788625243.308722:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+25:10841:x1875509185137408:12345-192.168.204.14@tcp:101:bash.0 Request processed in 1552us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625243.308734:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 99 00000100:00100000:0.0:1788625243.316414:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625243.316595:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185137664 00000100:00100000:3.0:1788625243.316605:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185137664 00000100:00100000:3.0:1788625243.316665:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 100 00000100:00100000:3.0:1788625243.316675:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+25:10841:x1875509185137664:12345-192.168.204.14@tcp:36:bash.0 00010000:00010000:3.0:1788625243.316889:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a9cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.316906:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a9cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.316918:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a9cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788625243.316955:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1788625243.316974:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ff2dffa reply state 000000005b5afab6 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a9cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.316986:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a9cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.317453:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:3.0:1788625243.317457:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788625243.317460:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788625243.317502:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1788625243.318141:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+29:10841:x1875509185137664:12345-192.168.204.14@tcp:36:bash.0 Request processed in 1464us (1731us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788625243.318150:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 100 00000020:00080000:3.0:1788625243.318155:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788625243.324149:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.324350:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185137792 00000100:00100000:2.0:1788625243.324361:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185137792 00000100:00100000:2.0:1788625243.325168:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 101 00000100:00100000:2.0:1788625243.325184:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+29:10841:x1875509185137792:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625243.325210:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625243.325231:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a9d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e18d expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.325307:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a9d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e18d expref: 30 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.325322:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a9d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e18d expref: 30 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.326244:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:2.0:1788625243.326248:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625243.326251:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6200, rc 0) 00000100:00100000:2.0:1788625243.326825:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+30:10841:x1875509185137792:12345-192.168.204.14@tcp:101:bash.0 Request processed in 1641us (2689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625243.326834:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 101 00000100:00100000:0.0:1788625243.330362:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.330906:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185137920 00000100:00100000:2.0:1788625243.330927:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185137920 00000100:00100000:2.0:1788625243.331039:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 41 00000100:00100000:2.0:1788625243.331065:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:10841:x1875509185137920:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625243.331086:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625243.331109:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4604636/0x2d2e3b3f34a7a9db lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e194 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625243.331133:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c4157, atime: 0x6a9c4155, ctime: 0x6a9c4157, blocks: 0x8 00010000:00010000:2.0:1788625243.331319:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1788625243.331325:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625243.331335:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4604636/0x2d2e3b3f34a7a9db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e194 expref: 7 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.331807:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4604636/0x2d2e3b3f34a7a9db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e194 expref: 7 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.331841:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7800, rc 0) 00000100:00080000:0.0:1788625243.332039:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625243.332768:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:10841:x1875509185137920:12345-192.168.204.14@tcp:101:bash.0 Request processed in 1714us (2421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625243.332796:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 41 00000100:00100000:1.0:1788625243.337862:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.342353:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185138048 00000100:00100000:2.0:1788625243.342370:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185138048 00002000:00010000:2.0:1788625243.342433:0:8429:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788625243.342438:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998744185c00 with x1875509185138048 ext(0->18446744073709551615) 00002000:00010000:2.0:1788625243.342450:0:8429:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff998744185c00. 00000100:00100000:2.0:1788625243.342490:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 1 00000100:00100000:2.0:1788625243.342500:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2391:x1875509185138048:12345-192.168.204.14@tcp:10:bash.0 00002000:00010000:2.0:1788625243.342998:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788625243.343002:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788625239 -> 1788625242 00002000:00010000:2.0:1788625243.343005:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788625237 -> 1788625237 00002000:00010000:2.0:1788625243.343007:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788625239 -> 1788625242 00002000:00010000:2.0:1788625243.343009:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788625243.343072:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2391:x1875509185138048:12345-192.168.204.14@tcp:10:bash.0 Request processed in 573us (5220us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788625243.343080:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 1 00002000:00010000:2.0:1788625243.343084:0:8429:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788625243.343087:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998744185c00 with x1875509185138048 ext(0->18446744073709551615) 00002000:00010000:2.0:1788625243.343092:0:8429:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff998744185c00. 00000100:00100000:1.0:1788625243.403966:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206186752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625243.403989:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206186880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625243.404044:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625243.404076:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206186880 00000100:00100000:1.0:1788625243.404085:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206186880 00000100:00100000:1.0:1788625243.404181:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788625243.404192:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206186880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788625243.404222:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788625243.404278:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625243.404818:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206186880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 626us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625243.404826:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788625243.404865:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206186880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625243.405836:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625243.406135:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206186752 00000100:00100000:2.0:1788625243.406143:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206186752 00000100:00080000:0.0:1788625243.406262:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625243.406305:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788625243.406336:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875509206186752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625243.406357:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625243.406434:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875509206186752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625243.406441:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788625243.406540:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206186752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625243.415704:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625243.415780:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185138176 00000100:00100000:0.0:1788625243.415793:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185138176 00000100:00100000:0.0:1788625243.415863:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 102 00000100:00100000:0.0:1788625243.415874:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+30:11338:x1875509185138176:12345-192.168.204.14@tcp:34:lfs.0 00010000:00010000:0.0:1788625243.415961:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a9e2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.415980:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a9e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.415994:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a9e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416035:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a9e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416042:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416101:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416174:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a9f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416207:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416216:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625243.416263:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416274:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a9e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416281:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a9e2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416287:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a9e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416293:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625243.416298:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a9e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416306:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a9e2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416318:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:0.0:1788625243.416322:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625243.416327:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a9e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416332:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7a9e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416358:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416365:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a9e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416371:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a9e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416377:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625243.416380:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a9e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416386:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a9e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416393:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988749c3600) 00010000:00010000:0.0:1788625243.416395:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625243.416398:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a9e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416404:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7a9e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416419:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416426:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a9f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416431:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a9f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416443:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625243.416446:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a9f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416451:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a9f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416459:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:0.0:1788625243.416461:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625243.416464:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a9f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.416469:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7a9f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625243.416630:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+30:11338:x1875509185138176:12345-192.168.204.14@tcp:34:lfs.0 Request processed in 755us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625243.416640:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 102 00000100:00100000:0.0:1788625243.452115:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625243.452354:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185138432 00000100:00100000:3.0:1788625243.452366:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185138432 00000100:00100000:3.0:1788625243.452436:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 103 00000100:00100000:3.0:1788625243.452448:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+30:11341:x1875509185138432:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625243.452469:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625243.452505:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a9f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e19b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.452808:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a9fe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.452836:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a9fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.452850:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a9fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.453035:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.453044:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.453051:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.453177:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.453200:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.453207:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625243.453217:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788625243.453304:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a9fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454042:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a9fe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454049:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a9fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454055:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625243.454060:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a9fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454068:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a9fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454082:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625243.454085:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625243.454090:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a9fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454097:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7a9fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454112:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454118:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454123:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454129:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625243.454139:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454146:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454155:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988625be000) 00010000:00010000:2.0:1788625243.454157:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625243.454160:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa05 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454166:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454500:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7a9f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e19b expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454739:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e19b expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.454748:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:2.0:1788625243.454750:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788625243.454753:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6a00, rc 0) 00000100:00100000:2.0:1788625243.454841:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+32:11341:x1875509185138432:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 2394us (2734us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788625243.454849:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 103 00000100:00100000:1.0:1788625243.461297:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.461561:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185138560 00000100:00100000:2.0:1788625243.461581:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185138560 00000100:00100000:2.0:1788625243.462437:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 104 00000100:00100000:2.0:1788625243.462446:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+32:11341:x1875509185138560:12345-192.168.204.14@tcp:54:lfs.0 00010000:00010000:2.0:1788625243.462534:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.462552:0:9824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e17f expref: 32 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.462563:0:9824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa1a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.462616:0:9824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e17f expref: 32 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.462631:0:9824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e17f expref: 32 pid: 9824 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625243.462647:0:9824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9824:1875509206187008:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625243.462871:0:9824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437daf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625243.465662:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625243.465949:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185138816 00000100:00100000:0.0:1788625243.465959:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185138816 00000100:00100000:0.0:1788625243.466021:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 22 00000100:00100000:0.0:1788625243.466035:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+33:6161:x1875509185138816:12345-192.168.204.14@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788625243.466086:0:9824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9824:1875509206187008:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625243.466184:0:9824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625243.467415:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+34:6161:x1875509185138816:12345-192.168.204.14@tcp:35:ldlm_bl.0 Request processed in 1375us (1760us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788625243.467426:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 22 00000100:00100000:0.0:1788625243.470057:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625243.470197:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185138944 00000100:00100000:3.0:1788625243.470207:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185138944 00010000:00010000:3.0:1788625243.470246:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e17f expref: 34 pid: 9824 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625243.470296:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 66 00000100:00100000:3.0:1788625243.470319:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+34:2393:x1875509185138944:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625243.470335:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625243.470341:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e17f expref: 34 pid: 9824 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.470355:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e17f expref: 34 pid: 9824 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.470375:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7a9b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e17f expref: 34 pid: 9824 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.470392:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:3.0:1788625243.470397:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.470407:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.470415:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa1a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.470451:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625243.470507:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+33:2393:x1875509185138944:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 189us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625243.470558:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 66 00010000:00010000:1.0:1788625243.470711:0:9824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.470730:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.470771:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.470779:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.470786:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.470792:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625243.470796:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.470803:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.470812:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:1.0:1788625243.470815:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625243.470818:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa1a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.470824:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aa1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625243.470863:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+32:11341:x1875509185138560:12345-192.168.204.14@tcp:54:lfs.0 Request processed in 8418us (9577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625243.470872:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 104 00000100:00100000:3.0:1788625243.474070:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625243.474435:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185139200 00000100:00100000:0.0:1788625243.474457:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185139200 00000100:00100000:0.0:1788625243.474873:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:0.0:1788625243.474885:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+32:11341:x1875509185139200:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:0.0:1788625243.475141:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+33:11341:x1875509185139200:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 257us (1080us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788625243.475149:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:0.0:1788625243.552232:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.552367:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185139456 00000100:00100000:2.0:1788625243.552377:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185139456 00000100:00100000:2.0:1788625243.552474:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 105 00000100:00100000:2.0:1788625243.552485:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+33:11352:x1875509185139456:12345-192.168.204.14@tcp:101:cat.0 00010000:00010000:2.0:1788625243.552508:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625243.552554:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e1a2 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.552688:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa28 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.552713:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.552724:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.552741:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.552748:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.552763:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.552872:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.552882:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.552889:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625243.552899:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788625243.553140:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553159:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa28 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553166:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553172:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625243.553176:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553184:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa28 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553204:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625243.553207:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625243.553212:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553218:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553232:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553238:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa2f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553244:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553249:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625243.553258:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553264:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553275:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988625be000) 00010000:00010000:2.0:1788625243.553278:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625243.553281:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa2f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553286:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553332:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1a2 expref: 36 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553346:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1a2 expref: 35 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.553354:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:2.0:1788625243.553356:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625243.553359:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7200, rc 0) 00000100:00100000:2.0:1788625243.553425:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+35:11352:x1875509185139456:12345-192.168.204.14@tcp:101:cat.0 Request processed in 942us (1202us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788625243.553433:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 105 00000100:00100000:3.0:1788625243.560942:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625243.561562:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185139712 00000100:00100000:0.0:1788625243.561573:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185139712 00000100:00100000:0.0:1788625243.561707:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:0.0:1788625243.561778:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+35:11352:x1875509185139712:12345-192.168.204.14@tcp:35:cat.0 00000100:00100000:0.0:1788625243.562596:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+36:11352:x1875509185139712:12345-192.168.204.14@tcp:35:cat.0 Request processed in 879us (1659us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788625243.562813:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:3.0:1788625243.590129:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.590625:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185139968 00000100:00100000:2.0:1788625243.590637:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185139968 00000100:00100000:2.0:1788625243.590711:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 106 00000100:00100000:2.0:1788625243.590722:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+36:11353:x1875509185139968:12345-192.168.204.14@tcp:36:rm.0 00010000:00010000:2.0:1788625243.590809:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788625243.590837:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7a9d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e18d expref: 36 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.590859:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1a2 expref: 35 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.590871:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e19b expref: 34 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.590883:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7a9c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e186 expref: 33 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.590898:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:2.0:1788625243.590903:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625243.590929:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa44 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.590942:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa44 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.590953:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa44 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.590967:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa4b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.590974:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.590991:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591066:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa52 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591075:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa52 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591082:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa52 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625243.591301:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788625243.591313:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364698794739ns, next at 365698792032ns, rc = 0 00010000:00010000:2.0:1788625243.591357:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aa59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591367:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aa59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591375:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aa59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591383:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aa59 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591391:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aa59 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591397:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aa59 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591432:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625243.591450:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa52 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591456:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa52 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591463:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa52 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591469:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625243.591473:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa52 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591481:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa52 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591490:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:2.0:1788625243.591492:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788625243.591495:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa52 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591501:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa52 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591566:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa44 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591573:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa44 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591578:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa44 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591599:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625243.591602:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa44 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591609:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa44 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591618:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625243.591620:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625243.591623:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa44 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591629:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa44 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625243.591638:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c3448d1 reply state 000000002ac6d514 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591651:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa4b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.591657:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988625be000) 00010000:00010000:2.0:1788625243.591660:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625243.591663:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625243.591747:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+34:11353:x1875509185139968:12345-192.168.204.14@tcp:36:rm.0 Request processed in 1025us (1625us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788625243.591755:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 106 00010000:00010000:1.0:1788625243.591829:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625243.591835:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aa59 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.591841:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625243.591844:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aa59 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.591851:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aa59 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.591860:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:1.0:1788625243.591862:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788625243.591865:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aa59 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.591871:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aa59 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.591882:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625243.591883:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625243.591885:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625243.631011:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.631116:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185140224 00000100:00100000:2.0:1788625243.631128:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185140224 00000100:00100000:2.0:1788625243.631198:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 107 00000100:00100000:2.0:1788625243.631228:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+34:11359:x1875509185140224:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625243.631254:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625243.631280:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa60 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e1a9 expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.631389:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa67 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.631409:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.631421:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.631432:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.631439:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.631446:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788625243.632576:0:9824:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788625243.632818:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.632831:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.632840:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.632888:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.632895:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa67 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.632901:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.632907:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625243.632911:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.632919:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa67 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.632931:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625243.632934:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625243.632939:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa67 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.632945:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa67 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625243.632958:0:9824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e54ace29 reply state 00000000ad5fcbb3 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.632969:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.632975:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988625be000) 00010000:00010000:2.0:1788625243.632989:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625243.632993:0:9824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788625243.633042:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa60 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1a9 expref: 37 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.633057:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1a9 expref: 36 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.633065:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be200) 00010000:00010000:2.0:1788625243.633067:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625243.633069:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7200, rc 0) 00000100:00100000:2.0:1788625243.633156:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+37:11359:x1875509185140224:12345-192.168.204.14@tcp:101:bash.0 Request processed in 1930us (2155us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788625243.633164:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 107 00000100:00100000:0.0:1788625243.636487:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.636601:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185140352 00000100:00100000:2.0:1788625243.636611:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185140352 00000100:00100000:2.0:1788625243.636730:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 42 00000100:00100000:2.0:1788625243.636739:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2392:x1875509185140352:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625243.636759:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625243.636781:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b398106/0x2d2e3b3f34a7aa83 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e1b0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625243.636806:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625243.636825:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1788625243.636830:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625243.636839:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b398106/0x2d2e3b3f34a7aa83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b0 expref: 8 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.636880:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b398106/0x2d2e3b3f34a7aa83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b0 expref: 8 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.636895:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6200, rc 0) 00000100:00100000:2.0:1788625243.636960:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2392:x1875509185140352:12345-192.168.204.14@tcp:101:bash.0 Request processed in 222us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625243.636968:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 42 00000100:00080000:0.0:1788625243.638090:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625243.641551:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625243.641702:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185140480 00000100:00100000:1.0:1788625243.641711:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185140480 00000100:00100000:1.0:1788625243.641812:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 43 00000100:00100000:1.0:1788625243.641823:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:11359:x1875509185140480:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:1.0:1788625243.641841:0:8868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625243.641861:0:8868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e1b7 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.641906:0:8868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b398106/0x2d2e3b3f34a7aa83 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b0 expref: 9 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.641916:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625243.641919:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625243.641925:0:8868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 9 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.641957:0:8868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009b398106/0x2d2e3b3f34a7aa83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b0 expref: 9 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.641971:0:8868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009b398106/0x2d2e3b3f34a7aa83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b0 expref: 9 pid: 8425 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625243.641986:0:8868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744184a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8868:1875509206187136:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625243.642098:0:8868:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842a87000 going to sleep for 11 seconds 00000100:00100000:2.0:1788625243.644865:0:8868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744184a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8868:1875509206187136:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625243.644904:0:8868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 9 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.644927:0:8868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5000, rc 0) 00000100:00100000:2.0:1788625243.645103:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:11359:x1875509185140480:12345-192.168.204.14@tcp:101:bash.0 Request processed in 3280us (3591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625243.645112:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 43 00000100:00100000:0.0:1788625243.645744:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625243.645807:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185140608 00000100:00100000:3.0:1788625243.645814:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185140608 00010000:00010000:3.0:1788625243.645848:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009b398106/0x2d2e3b3f34a7aa83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b0 expref: 9 pid: 8425 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625243.645888:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 67 00000100:00100000:3.0:1788625243.645898:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:2393:x1875509185140608:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625243.645913:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625243.645934:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009b398106/0x2d2e3b3f34a7aa83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b0 expref: 9 pid: 8425 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.645949:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009b398106/0x2d2e3b3f34a7aa83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b0 expref: 9 pid: 8425 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.645976:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b398106/0x2d2e3b3f34a7aa83 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b0 expref: 9 pid: 8425 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.645993:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625243.645997:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625243.646006:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 8 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.646017:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 8 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.646051:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 8 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625243.646080:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858357100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1875509206187264:192.168.204.14@tcp:105: 00000100:00100000:3.0:1788625243.646154:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fea300 going to sleep for 11 seconds 00000100:00100000:3.0:1788625243.649894:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.650098:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185140864 00000100:00100000:2.0:1788625243.650113:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185140864 00000100:00100000:2.0:1788625243.650180:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:2.0:1788625243.650191:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+37:11359:x1875509185140864:12345-192.168.204.14@tcp:35:bash.0 00000100:00100000:2.0:1788625243.650548:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+38:11359:x1875509185140864:12345-192.168.204.14@tcp:35:bash.0 Request processed in 357us (661us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788625243.650556:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:0.0:1788625243.650738:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858357100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1875509206187264:192.168.204.14@tcp:105: 00010000:00010000:0.0:1788625243.650763:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625243.650798:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2393:x1875509185140608:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 4902us (5057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625243.650806:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 67 00000100:00100000:3.0:1788625243.760057:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.760312:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185140992 00000100:00100000:2.0:1788625243.760335:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185140992 00000100:00100000:2.0:1788625243.760399:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 108 00000100:00100000:2.0:1788625243.760410:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+38:11375:x1875509185140992:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625243.760431:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625243.760451:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e1be expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.760620:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.760636:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.760648:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625243.760694:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788625243.760698:0:11318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625243.760718:0:11318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.760743:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aa91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1be expref: 40 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.760761:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1be expref: 39 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.760770:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625243.760773:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625243.760777:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7e00, rc 0) 00000100:00100000:2.0:1788625243.760846:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+39:11375:x1875509185140992:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 439us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625243.760853:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 108 00000100:00100000:3.0:1788625243.764339:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.764462:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185141248 00000100:00100000:2.0:1788625243.764477:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185141248 00000100:00100000:2.0:1788625243.764633:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 109 00000100:00100000:2.0:1788625243.764644:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+39:11375:x1875509185141248:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625243.764666:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625243.764688:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7aa9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e1c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.764814:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aaa6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.764829:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aaa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.764841:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aaa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625243.764851:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788625243.764957:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7aa9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1c5 expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.764977:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aaa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1c5 expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.764986:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be200) 00010000:00010000:2.0:1788625243.764989:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625243.765006:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7000, rc 0) 00000100:00100000:2.0:1788625243.765068:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+41:11375:x1875509185141248:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 425us (737us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1788625243.765076:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 109 00000100:00100000:3.0:1788625243.768031:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625243.768084:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.768195:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185141632 00000100:00100000:0.0:1788625243.768197:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185141376 00000100:00100000:2.0:1788625243.768205:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185141632 00000100:00100000:0.0:1788625243.768205:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185141376 00000100:00100000:2.0:1788625243.768253:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 110 00000100:00100000:0.0:1788625243.768256:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:2.0:1788625243.768262:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:11375:x1875509185141632:12345-192.168.204.14@tcp:101:lfs.0 00000100:00100000:0.0:1788625243.768262:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:2394:x1875509185141376:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625243.768282:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625243.768288:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625243.768299:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aab4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e1cc expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.768309:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7aaa6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1c5 expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.768324:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be200) 00010000:00010000:0.0:1788625243.768329:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625243.768397:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aabb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.768412:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aabb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.768422:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aabb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625243.768424:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:2394:x1875509185141376:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 161us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625243.768431:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 7 00000004:00200000:2.0:1788625243.768434:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788625243.768560:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aab4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1cc expref: 43 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.768575:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aabb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1cc expref: 42 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.768597:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be200) 00010000:00010000:2.0:1788625243.768606:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788625243.768609:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7c00, rc 0) 00000100:00100000:2.0:1788625243.768647:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:11375:x1875509185141632:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 386us (562us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1788625243.768654:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 110 00000100:00100000:3.0:1788625243.772997:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.773506:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185141760 00000100:00100000:2.0:1788625243.773555:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185141760 00000100:00100000:2.0:1788625243.773738:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 44 00000100:00100000:2.0:1788625243.773749:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2392:x1875509185141760:12345-192.168.204.14@tcp:1:lfs.0 00010000:00010000:2.0:1788625243.773796:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724afcac/0x2d2e3b3f34a7aac9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.773853:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 8 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.773863:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625243.773868:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788625243.773872:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000724afcac/0x2d2e3b3f34a7aac9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.773912:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 8 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.773927:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 8 pid: 8868 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625243.773941:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8425:1875509206187392:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625243.774236:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da540 going to sleep for 11 seconds 00000100:00100000:0.0:1788625243.777708:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625243.777841:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185141888 00000100:00100000:1.0:1788625243.777851:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185141888 00000100:00100000:2.0:1788625243.777868:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8425:1875509206187392:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625243.777898:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000724afcac/0x2d2e3b3f34a7aac9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1788625243.777905:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9987439c4a80 x1875509185141888/t0(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:54/0 lens 504/0 e 0 to 0 dl 1788625254 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625243.777916:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9987439c4a80 with x1875509185141888 ext(0->8) 00010000:00010000:1.0:1788625243.777924:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 9 pid: 8868 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.777958:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 9 pid: 8868 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625243.777966:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9987439c4a80 00000100:00100000:1.0:1788625243.778003:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 1 00000100:00100000:1.0:1788625243.778012:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:2394:x1875509185141888:12345-192.168.204.14@tcp:4:lfs.0 00000100:00100000:1.0:1788625243.781050:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:2394:x1875509185141888:12345-192.168.204.14@tcp:4:lfs.0 Request processed in 3030us (3343us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788625243.781063:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 1 00002000:00100000:1.0:1788625243.781080:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9987439c4a80 x1875509185141888/t4294967303(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:54/0 lens 504/448 e 0 to 0 dl 1788625254 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625243.781091:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9987439c4a80 with x1875509185141888 ext(0->8) 00010000:00010000:1.0:1788625243.781102:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 11 pid: 8868 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.781122:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 11 pid: 8868 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625243.781130:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9987439c4a80 00000001:00080000:0.0:1788625243.782190:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1788625243.782201:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:0.0:1788625243.784095:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625243.784131:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185142016 00000100:00100000:3.0:1788625243.784146:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185142016 00010000:00010000:3.0:1788625243.784184:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 9 pid: 8868 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625243.784234:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 68 00000100:00100000:3.0:1788625243.784243:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:2391:x1875509185142016:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625243.784256:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788625243.784273:0:9513:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788625243.784276:0:9513:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788625242 00002000:00010000:3.0:1788625243.784278:0:9513:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788625242 00002000:00010000:3.0:1788625243.784280:0:9513:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788625242 00002000:00010000:3.0:1788625243.784282:0:9513:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788625243.784288:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 9 pid: 8868 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.784303:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 9 pid: 8868 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.784339:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7aa8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1b7 expref: 9 pid: 8868 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.784354:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625243.784358:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625243.784364:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000724afcac/0x2d2e3b3f34a7aac9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.784374:0:9513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000724afcac/0x2d2e3b3f34a7aac9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.784407:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625243.784459:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2391:x1875509185142016:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 217us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625243.784468:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 68 00010000:00010000:2.0:1788625243.784617:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000724afcac/0x2d2e3b3f34a7aac9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.784628:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000724afcac/0x2d2e3b3f34a7aac9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.784648:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724afcac/0x2d2e3b3f34a7aac9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.784657:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000724afcac/0x2d2e3b3f34a7aac9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.784665:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000724afcac/0x2d2e3b3f34a7aac9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.784672:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625243.784677:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000724afcac/0x2d2e3b3f34a7aac9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.784686:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000724afcac/0x2d2e3b3f34a7aac9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.784711:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000724afcac/0x2d2e3b3f34a7aac9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.784719:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000724afcac/0x2d2e3b3f34a7aac9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625243.784776:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2392:x1875509185141760:12345-192.168.204.14@tcp:1:lfs.0 Request processed in 11028us (11790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625243.784785:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 44 00000100:00100000:0.0:1788625243.790395:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625243.790615:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185142272 00000100:00100000:1.0:1788625243.790625:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185142272 00000100:00100000:1.0:1788625243.790687:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 26 00000100:00100000:1.0:1788625243.790698:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844c52850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:11375:x1875509185142272:12345-192.168.204.14@tcp:35:lfs.0 00000004:00010000:1.0:1788625243.790779:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aabb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1cc expref: 42 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625243.791158:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1788625243.791187:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788625243.791548:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1788625243.791599:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aad0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.791613:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1a9 expref: 46 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.791622:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aad0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.791654:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1a9 expref: 46 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.791669:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1a9 expref: 46 pid: 9824 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625243.791683:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744187b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6515:1875509206187520:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625243.791770:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842a87d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625243.795374:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625243.795466:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185142400 00000100:00100000:3.0:1788625243.795475:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185142400 00010000:00010000:3.0:1788625243.795511:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa75 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1a9 expref: 47 pid: 9824 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625243.795575:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 69 00000100:00100000:3.0:1788625243.795596:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+47:2393:x1875509185142400:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625243.795611:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625243.795618:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa75 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1a9 expref: 47 pid: 9824 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.795649:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1a9 expref: 47 pid: 9824 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.795670:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be200) 00010000:00010000:3.0:1788625243.795675:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aad0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.795685:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aad0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.795693:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aad0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625243.795711:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625243.795771:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+47:2393:x1875509185142400:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 177us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625243.795779:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 69 00010000:00010000:1.0:1788625243.795993:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aa75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1a9 expref: 46 pid: 9824 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625243.796010:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744187b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6515:1875509206187520:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625243.796033:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aad0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.796049:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aad0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.796055:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aad0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625243.796153:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1788625243.796267:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1788625243.796361:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744187b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1875509206187648:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788625243.796405:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625243.797067:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206187648 00000100:00100000:3.0:1788625243.797073:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206187648 00000100:00100000:1.0:1788625243.797078:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842a87840 going to sleep for 11 seconds 00000100:00100000:3.0:1788625243.797126:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788625243.797135:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1875509206187648:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788625243.798140:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1875509206187648:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1005us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625243.798150:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788625243.798196:0:6515:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1788625243.798202:0:6515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:1.0:1788625243.798221:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99887f8a5180, transno 4294967302 00000100:00100000:1.0:1788625243.798242:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744187b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1875509206187648:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788625243.798371:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1788625243.798425:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744187b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1875509206187776:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788625243.798458:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625243.798713:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842a87180 going to sleep for 11 seconds 00000100:00100000:0.0:1788625243.798846:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206187776 00000100:00100000:0.0:1788625243.798853:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206187776 00000100:00100000:0.0:1788625243.798893:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788625243.798901:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1875509206187776:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788625243.799093:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6515:x1875509206187776:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 192us (633us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788625243.799100:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788625243.799155:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744187b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1875509206187776:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788625243.799193:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1788625243.799228:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aad0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.799238:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aad0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.799245:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aad0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.799263:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625243.799328:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aad0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.799337:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aad0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.799352:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be200) 00010000:00010000:1.0:1788625243.799355:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788625243.799360:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aad0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.799366:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aad0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788625243.799452:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788625243.799506:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788625243.799748:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 364907229988ns, next at 365907226762ns, rc = 0 00000001:00080000:1.0:1788625243.799757:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1788625243.799783:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be200) 00010000:00010000:1.0:1788625243.799786:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788625243.799793:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aabb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1cc expref: 50 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625243.799941:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844c52850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+49:11375:x1875509185142272:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 9245us (9556us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788625243.799949:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 26 00000020:00080000:1.0:1788625243.799953:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788625243.806017:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.806367:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185142528 00000100:00100000:2.0:1788625243.806379:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185142528 00000100:00100000:2.0:1788625243.806444:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 111 00000100:00100000:2.0:1788625243.806456:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+49:11375:x1875509185142528:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625243.806481:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625243.806505:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aad7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e1d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.806608:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aad7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1d3 expref: 50 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.806689:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aad7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1d3 expref: 50 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.806709:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625243.806712:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625243.806731:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6800, rc 0) 00000100:00100000:2.0:1788625243.806789:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+50:11375:x1875509185142528:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 335us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625243.806796:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 111 00000100:00100000:0.0:1788625243.812124:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625243.812211:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185142784 00000100:00100000:1.0:1788625243.812220:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185142784 00000100:00100000:1.0:1788625243.812287:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 27 00000100:00100000:1.0:1788625243.812299:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+50:11375:x1875509185142784:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:1.0:1788625243.813085:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+51:11375:x1875509185142784:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 788us (968us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788625243.813094:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 27 00000100:00100000:0.0:1788625243.869842:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625243.869942:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185142912 00000100:00100000:2.0:1788625243.869953:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185142912 00000100:00100000:2.0:1788625243.870014:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 112 00000100:00100000:2.0:1788625243.870024:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+51:11385:x1875509185142912:12345-192.168.204.14@tcp:34:lfs.0 00010000:00010000:2.0:1788625243.870099:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7aade lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870126:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7aade lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870139:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7aade lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870161:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aae5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870172:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870179:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870259:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aaec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870265:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aaec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870285:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aaec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625243.870325:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aaec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870335:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7aade lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870338:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7aade lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870343:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7aade lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870347:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625243.870350:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7aade lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870354:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7aade lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870362:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625243.870364:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625243.870367:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7aade lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870371:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7aade lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870379:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870444:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aae5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870448:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aae5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870451:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625243.870453:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aae5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870458:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aae5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870466:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988625be000) 00010000:00010000:2.0:1788625243.870469:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625243.870472:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aae5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870478:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7aae5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870487:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aaec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870493:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aaec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870498:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aaec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870503:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625243.870512:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aaec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870842:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aaec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870851:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625243.870853:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625243.870856:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aaec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625243.870862:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7aaec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625243.870981:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+51:11385:x1875509185142912:12345-192.168.204.14@tcp:34:lfs.0 Request processed in 957us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625243.870990:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 112 00000100:00100000:0.0:1788625243.916021:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206188160:0@lo:400:kworker.0 00000100:00100000:0.0:1788625243.916114:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625243.916179:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206188672:0@lo:400:kworker.0 00000100:00100000:0.0:1788625243.916204:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625243.916436:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206187904:0@lo:400:kworker.0 00000100:00100000:3.0:1788625243.916477:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625243.918930:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206189184:0@lo:400:kworker.0 00000100:00100000:3.0:1788625243.919045:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206188416:0@lo:400:kworker.0 00000100:00100000:0.0:1788625243.919107:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625243.919141:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788625243.919148:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206188032:0@lo:400:kworker.0 00000100:00100000:0.0:1788625243.919166:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625243.919181:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744051f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206188544:0@lo:400:kworker.0 00000100:00100000:0.0:1788625243.919197:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625243.919211:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206189056:0@lo:400:kworker.0 00000100:00100000:1.0:1788625243.919233:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625243.919396:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625243.919419:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206188928:0@lo:400:kworker.0 00000100:00100000:3.0:1788625243.919438:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625243.919453:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206189440:0@lo:400:kworker.0 00000100:00100000:0.0:1788625243.920060:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206188672 00000100:00100000:0.0:1788625243.920070:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206188672 00000100:00100000:0.0:1788625243.920121:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206189184 00000100:00100000:0.0:1788625243.920124:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206189184 00000100:00100000:0.0:1788625243.920136:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206188032 00000100:00100000:0.0:1788625243.920137:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206188032 00000100:00100000:0.0:1788625243.920153:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206188544 00000100:00100000:0.0:1788625243.920154:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206188544 00000100:00100000:0.0:1788625243.920164:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185143168 00000100:00100000:0.0:1788625243.920166:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185143168 00000100:00100000:0.0:1788625243.920181:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788625243.920189:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206188672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625243.920239:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788625243.920244:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206188672:12345-0@lo:400:kworker.0 Request processed in 54us (4037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625243.920254:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206189184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625243.920254:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788625243.920275:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788625243.920292:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206188032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625243.920299:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206189184:12345-0@lo:400:kworker.0 Request processed in 49us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625243.920372:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788625243.920386:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788625243.920402:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206188544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625243.921393:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206188032:12345-0@lo:400:kworker.0 Request processed in 1097us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625243.921403:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788625243.921418:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206188544:12345-0@lo:400:kworker.0 Request processed in 1023us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625243.921428:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788625243.921436:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 113 00000100:00100000:0.0:1788625243.921453:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+51:11388:x1875509185143168:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:0.0:1788625243.921469:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625243.921492:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7aaf3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e1da expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.921603:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aafa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.921618:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aafa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.921633:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aafa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.921646:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ab01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.921654:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ab01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.921661:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ab01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.921829:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ab08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.921859:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ab08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.921867:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ab08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625243.921878:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788625243.921972:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aafa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.921980:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aafa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625243.921986:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206187904 00010000:00010000:0.0:1788625243.921992:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aafa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625243.921995:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206187904 00010000:00010000:0.0:1788625243.922002:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625243.922007:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aafa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625243.922015:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625243.922015:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aafa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.922033:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:0.0:1788625243.922037:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625243.922041:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00010000:00010000:0.0:1788625243.922042:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aafa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.922051:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aafa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625243.922054:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206187904:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1788625243.922075:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ab01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625243.922080:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00010000:00010000:0.0:1788625243.922092:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ab01 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625243.922095:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206188288:0@lo:400:kworker.0 00010000:00010000:0.0:1788625243.922104:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ab01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625243.922112:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625243.922115:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ab01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625243.922118:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206187904:12345-0@lo:400:kworker.0 Request processed in 56us (5628us total) trans 0 rc 0/0 00010000:00010000:0.0:1788625243.922121:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ab01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625243.922134:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00010000:00010000:0.0:1788625243.922138:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988625be000) 00010000:00010000:0.0:1788625243.922142:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625243.922146:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ab01 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625243.922155:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625243.922157:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ab01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625243.922176:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206188800:0@lo:400:kworker.0 00000100:00100000:2.0:1788625243.922188:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206188160 00000100:00100000:2.0:1788625243.922194:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206188160 00010000:00010000:0.0:1788625243.922201:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7aaf3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1da expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625243.922209:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625243.922220:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206188416 00000100:00100000:2.0:1788625243.922225:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206188416 00000100:00100000:1.0:1788625243.922229:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206188288 00010000:00010000:0.0:1788625243.922235:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ab08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1da expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625243.922238:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206189312:0@lo:400:kworker.0 00000100:00100000:1.0:1788625243.922238:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206188288 00000100:00100000:2.0:1788625243.922248:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00010000:00010000:0.0:1788625243.922254:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:0.0:1788625243.922258:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:2.0:1788625243.922264:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206188160:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1788625243.922269:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995000, rc 0) 00000100:00100000:3.0:1788625243.922279:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625243.922284:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788625243.922296:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206188288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625243.922322:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+53:11388:x1875509185143168:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 871us (3090us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788625243.922324:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206187904:0@lo:400:kworker.0 00000100:00100000:2.0:1788625243.922332:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206188160:12345-0@lo:400:kworker.0 Request processed in 71us (6215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625243.922340:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 113 00000100:00100000:2.0:1788625243.922346:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788625243.922353:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206188288:12345-0@lo:400:kworker.0 Request processed in 58us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625243.922367:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206188288:0@lo:400:kworker.0 00000100:00080000:0.0:1788625243.922370:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625243.922372:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00080000:0.0:1788625243.922379:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788625243.922385:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206188416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625243.922404:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206188928 00000100:00100000:3.0:1788625243.922410:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206188928 00000100:00100000:2.0:1788625243.922428:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206188416:12345-0@lo:400:kworker.0 Request processed in 46us (3034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625243.922436:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625243.922437:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206189440 00000100:00100000:3.0:1788625243.922442:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206189440 00000100:00100000:2.0:1788625243.922443:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788625243.922472:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206189056 00000100:00100000:2.0:1788625243.922477:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206189056 00000100:00100000:3.0:1788625243.922478:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206188800 00000100:00100000:3.0:1788625243.922483:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206188800 00000100:00100000:0.0:1788625243.922485:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206188160:0@lo:400:kworker.0 00010000:00080000:0.0:1788625243.922505:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744050a80 x1875509206188672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625243.922507:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206189312 00000100:00100000:3.0:1788625243.922512:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206189312 00000100:00100000:3.0:1788625243.922551:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788625243.922563:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206188672:0@lo:400:kworker.0 00000100:00100000:3.0:1788625243.922564:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1875509206188928:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788625243.922594:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744050e00 x1875509206189184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625243.922605:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206189184:0@lo:400:kworker.0 00000100:00100000:3.0:1788625243.922625:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1875509206188928:12345-0@lo:400:kworker.0 Request processed in 62us (3183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625243.922637:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206188032:0@lo:400:kworker.0 00000100:00100000:3.0:1788625243.922647:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788625243.922655:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744051f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206188544:0@lo:400:kworker.0 00000100:00100000:3.0:1788625243.922668:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788625243.922677:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1875509206189440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625243.922689:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788625243.922713:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1875509206189440:12345-0@lo:400:kworker.0 Request processed in 37us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625243.922719:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788625243.922725:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788625243.922741:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788625243.922748:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206188800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625243.922760:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206189056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625243.922781:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206188800:12345-0@lo:400:kworker.0 Request processed in 33us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625243.922788:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788625243.922803:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788625243.922813:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206189312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625243.922815:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206189056:12345-0@lo:400:kworker.0 Request processed in 59us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625243.922826:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788625243.922854:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206189312:12345-0@lo:400:kworker.0 Request processed in 44us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625243.922861:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206189056:0@lo:400:kworker.0 00000100:00100000:3.0:1788625243.922865:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1788625243.922904:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788625243.922909:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625243.924316:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206188800:0@lo:400:kworker.0 00000100:00100000:3.0:1788625243.924337:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206189312:0@lo:400:kworker.0 00000100:00100000:3.0:1788625243.924351:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206188416:0@lo:400:kworker.0 00000100:00100000:3.0:1788625243.924362:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206188928:0@lo:400:kworker.0 00000100:00100000:3.0:1788625243.924372:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206189440:0@lo:400:kworker.0 00000100:00100000:0.0:1788625243.927973:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625243.928049:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185143296 00000100:00100000:1.0:1788625243.928078:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185143296 00000100:00100000:1.0:1788625243.928149:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 114 00000100:00100000:1.0:1788625243.928157:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+53:11388:x1875509185143296:12345-192.168.204.14@tcp:54:lfs.0 00010000:00010000:1.0:1788625243.928229:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ab16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.928249:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ab16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.928262:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ab16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.928300:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ab16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.928307:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ab16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.928314:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ab16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.928319:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625243.928324:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ab16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.928331:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ab16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.928343:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:1.0:1788625243.928346:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625243.928351:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ab16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625243.928381:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ab16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625243.928507:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+53:11388:x1875509185143296:12345-192.168.204.14@tcp:54:lfs.0 Request processed in 348us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625243.928556:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 114 00000100:00100000:0.0:1788625243.939015:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625243.939606:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185143552 00000100:00100000:1.0:1788625243.939616:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185143552 00000100:00100000:1.0:1788625243.939695:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 28 00000100:00100000:1.0:1788625243.939707:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+53:11388:x1875509185143552:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:1.0:1788625243.940176:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+54:11388:x1875509185143552:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 470us (1169us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788625243.940185:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 28 00000100:00100000:0.0:1788625244.017731:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.017886:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185143808 00000100:00100000:2.0:1788625244.017896:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185143808 00000100:00100000:2.0:1788625244.017960:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 115 00000100:00100000:2.0:1788625244.017970:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+54:11398:x1875509185143808:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625244.017996:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625244.017999:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788625244.018026:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7aa98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1be expref: 54 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.018046:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625244.018052:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625244.018066:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab1d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e1e1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.018184:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.018199:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ab08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1da expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.018226:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.018261:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ab08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1da expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.018276:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ab08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1da expref: 54 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.018290:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206189568:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625244.018614:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da540 going to sleep for 11 seconds 00000100:00100000:2.0:1788625244.023963:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206189568:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625244.023995:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625244.024652:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625244.025033:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185143936 00000100:00100000:3.0:1788625244.025058:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185143936 00010000:00010000:3.0:1788625244.025099:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ab08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1da expref: 55 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625244.025209:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 70 00000100:00100000:3.0:1788625244.025220:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744050a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+55:2393:x1875509185143936:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625244.025235:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625244.025243:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ab08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1da expref: 55 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.025266:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ab08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1da expref: 55 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.025296:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ab08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1da expref: 55 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.025317:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:3.0:1788625244.025322:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.025331:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.025340:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.025377:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625244.025443:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744050a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+54:2393:x1875509185143936:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 224us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625244.025460:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 70 00010000:00010000:2.0:1788625244.025590:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.025598:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625244.025620:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788625244.026227:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab1d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e1 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.026246:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e1 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.026278:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625244.026282:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788625244.026285:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7c00, rc 0) 00000100:00100000:2.0:1788625244.026329:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+54:11398:x1875509185143808:12345-192.168.204.14@tcp:101:bash.0 Request processed in 8360us (8608us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788625244.026336:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 115 00000100:00100000:0.0:1788625244.031744:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.031819:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185144064 00000100:00100000:2.0:1788625244.031830:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185144064 00000100:00100000:2.0:1788625244.031885:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 116 00000100:00100000:2.0:1788625244.031896:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+54:11398:x1875509185144064:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625244.031921:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625244.031942:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e1e8 expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.031976:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7ab39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.031989:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7ab39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.032000:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7ab39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.032107:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e8 expref: 56 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.032125:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7ab39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e8 expref: 55 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.032141:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625244.032144:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788625244.032148:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7e00, rc 0) 00000100:00100000:2.0:1788625244.032207:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+55:11398:x1875509185144064:12345-192.168.204.14@tcp:101:bash.0 Request processed in 313us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625244.032215:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 116 00000100:00100000:0.0:1788625244.039319:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.039841:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185144320 00000100:00100000:2.0:1788625244.039852:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185144320 00000100:00100000:2.0:1788625244.039954:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 117 00000100:00100000:2.0:1788625244.039964:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+55:11398:x1875509185144320:12345-192.168.204.14@tcp:36:bash.0 00010000:00010000:2.0:1788625244.040205:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.040224:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.040235:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625244.040290:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788625244.040311:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0291cfc reply state 00000000025659c5 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.040324:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.040332:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625244.040335:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625244.040355:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625244.040459:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:11398:x1875509185144320:12345-192.168.204.14@tcp:36:bash.0 Request processed in 496us (1148us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788625244.040467:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 117 00000020:00080000:2.0:1788625244.040472:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788625244.045999:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.046179:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185144448 00000100:00100000:2.0:1788625244.046190:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185144448 00000100:00100000:2.0:1788625244.046248:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 118 00000100:00100000:2.0:1788625244.046357:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:11398:x1875509185144448:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625244.046385:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625244.046411:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7ab47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e1ef expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.046598:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.046614:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e1 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.046623:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.046728:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e1 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.046743:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e1 expref: 59 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.046757:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206189696:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625244.046900:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da540 going to sleep for 11 seconds 00000100:00100000:2.0:1788625244.050904:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206189696:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625244.050934:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625244.056365:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625244.057244:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185144576 00000100:00100000:3.0:1788625244.057256:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185144576 00010000:00010000:3.0:1788625244.057361:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e1 expref: 60 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625244.057453:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 71 00000100:00100000:3.0:1788625244.057464:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:2394:x1875509185144576:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625244.057479:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625244.057486:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e1 expref: 60 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.057501:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e1 expref: 60 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.057539:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab24 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e1 expref: 60 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.057566:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:3.0:1788625244.057580:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.057591:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.057600:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.057660:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625244.057693:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.057705:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625244.057735:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:2394:x1875509185144576:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 272us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625244.057744:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 71 00000004:00200000:2.0:1788625244.057765:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788625244.057937:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625244.057965:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.058002:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7ab47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1ef expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.058018:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1ef expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.058025:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625244.058029:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625244.058031:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac6e00, rc 0) 00000100:00100000:2.0:1788625244.058074:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:11398:x1875509185144448:12345-192.168.204.14@tcp:101:bash.0 Request processed in 11818us (12085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625244.058082:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 118 00000100:00100000:0.0:1788625244.061102:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625244.061165:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185144832 00000100:00100000:1.0:1788625244.061176:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185144832 00000100:00100000:1.0:1788625244.061235:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 29 00000100:00100000:1.0:1788625244.061245:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:11398:x1875509185144832:12345-192.168.204.14@tcp:35:bash.0 00000100:00100000:1.0:1788625244.061563:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:11398:x1875509185144832:12345-192.168.204.14@tcp:35:bash.0 Request processed in 319us (468us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1788625244.061584:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 29 00000100:00100000:1.0:1788625244.130509:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.130651:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185144960 00000100:00100000:2.0:1788625244.130674:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185144960 00000100:00100000:2.0:1788625244.130740:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 119 00000100:00100000:2.0:1788625244.130751:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:11404:x1875509185144960:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625244.130779:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625244.130802:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7ab55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e1f6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.130869:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7ab5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.130884:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7ab5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.130896:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7ab5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625244.130942:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788625244.130952:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625244.130972:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7ab5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.130995:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6200/0x2d2e3b3f34a7ab55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1f6 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.131013:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7ab5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1f6 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.131022:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625244.131025:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625244.131028:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887cac7000, rc 0) 00000100:00100000:2.0:1788625244.131104:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:11404:x1875509185144960:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 354us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625244.131112:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 119 00000100:00100000:0.0:1788625244.133986:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.134404:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185145088 00000100:00100000:2.0:1788625244.134416:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185145088 00000100:00100000:2.0:1788625244.134478:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 120 00000100:00100000:2.0:1788625244.134489:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:11404:x1875509185145088:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625244.134512:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625244.134554:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e1fd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.134650:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab6a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.134665:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.134677:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.134689:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.134696:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.134703:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.134769:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.134784:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.134792:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625244.134832:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788625244.134836:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625244.134853:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.134866:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.134874:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.134881:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab6a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.134888:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.134894:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625244.135186:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.135197:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab6a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.135211:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625244.135214:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625244.135226:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.135233:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.135249:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.135256:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.135263:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.135269:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625244.135272:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.135279:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.135287:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988625be000) 00010000:00010000:2.0:1788625244.135289:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625244.135293:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.135299:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.135329:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7c00/0x2d2e3b3f34a7ab63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1fd expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.135355:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1fd expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.135363:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625244.135365:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625244.135368:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188800, rc 0) 00000100:00100000:2.0:1788625244.135454:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11404:x1875509185145088:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 968us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625244.135462:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 120 00000100:00100000:0.0:1788625244.143092:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.143236:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185145472 00000100:00100000:2.0:1788625244.143248:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185145472 00000100:00100000:2.0:1788625244.143315:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 121 00000100:00100000:2.0:1788625244.143327:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11404:x1875509185145472:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625244.143360:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625244.143381:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e204 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.143554:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.143581:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1ef expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.143590:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1fd expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.143622:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.143659:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1fd expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.143673:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1fd expref: 62 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.143686:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206189824:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625244.143810:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1ef expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.143819:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1ef expref: 62 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.143827:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206189952:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625244.143860:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437dacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625244.144345:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625244.144430:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185145216 00000100:00100000:0.0:1788625244.144436:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185145216 00010000:00010000:0.0:1788625244.144464:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab78 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1fd expref: 63 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625244.144499:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 72 00000100:00100000:0.0:1788625244.144508:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744187800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:2393:x1875509185145216:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625244.144546:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625244.144554:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab78 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1fd expref: 63 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.144567:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1fd expref: 63 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.144605:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:0.0:1788625244.144610:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.144644:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.144651:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625244.144692:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744187800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:2393:x1875509185145216:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 185us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625244.144700:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 72 00000100:00100000:0.0:1788625244.147082:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625244.147162:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185145600 00000100:00100000:3.0:1788625244.147170:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185145600 00010000:00010000:2.0:1788625244.147196:0:6512:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.14@tcp) returned -22 from blocking AST (req@0000000063d955a5 x1875509206189824) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab78 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1fd expref: 63 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.147207:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1ef expref: 63 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.147222:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1fd expref: 63 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.147240:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206189824:192.168.204.14@tcp:104: 00000100:00100000:3.0:1788625244.147249:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 73 00000100:00100000:3.0:1788625244.147262:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744050000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+62:2394:x1875509185145600:12345-192.168.204.14@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788625244.147274:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206189952:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625244.147277:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625244.147285:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1ef expref: 62 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.147299:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1ef expref: 62 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.147312:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625244.147319:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.147328:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.147338:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.147373:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6e00/0x2d2e3b3f34a7ab4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1ef expref: 62 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.147385:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:3.0:1788625244.147390:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.147399:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.147418:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.147448:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625244.147514:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.147618:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625244.147621:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744050000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:2394:x1875509185145600:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 361us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625244.147636:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 73 00000004:00200000:2.0:1788625244.147645:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788625244.147883:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e204 expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.147900:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e204 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.147908:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625244.147911:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788625244.147914:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188e00, rc 0) 00000100:00100000:2.0:1788625244.147940:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11404:x1875509185145472:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 4617us (4860us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788625244.147957:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 121 00000100:00100000:3.0:1788625244.153456:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.153781:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185145856 00000100:00100000:2.0:1788625244.153793:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185145856 00000100:00100000:2.0:1788625244.153897:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00100000:2.0:1788625244.153908:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11404:x1875509185145856:12345-192.168.204.14@tcp:103:lfs.0 00010000:00010000:2.0:1788625244.153923:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625244.153945:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6800/0x2d2e3b3f34a7aad7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1d3 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.153961:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625244.153966:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625244.154023:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:11404:x1875509185145856:12345-192.168.204.14@tcp:103:lfs.0 Request processed in 117us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625244.154031:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00100000:1.0:1788625244.157969:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.158124:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185145984 00000100:00100000:2.0:1788625244.158134:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185145984 00000100:00100000:2.0:1788625244.158191:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 122 00000100:00100000:2.0:1788625244.158201:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:11404:x1875509185145984:12345-192.168.204.14@tcp:58:lfs.0 00010000:00010000:2.0:1788625244.158477:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab94 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.158496:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.158510:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625244.158863:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788625244.159001:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:11404:x1875509185145984:12345-192.168.204.14@tcp:58:lfs.0 Request processed in 799us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625244.159009:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 122 00000100:00100000:1.0:1788625244.163076:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.163182:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185146112 00000100:00100000:2.0:1788625244.163192:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185146112 00000100:00100000:2.0:1788625244.163340:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 123 00000100:00100000:2.0:1788625244.163351:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:11404:x1875509185146112:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625244.163371:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625244.163391:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e20b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.163447:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab94 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.163458:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab9b lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e20b expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.163476:0:6513:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.163488:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab9b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e20b expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.163501:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625244.163504:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625244.163507:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab9b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e20b expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.163610:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188800, rc 0) 00000100:00100000:2.0:1788625244.163831:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11404:x1875509185146112:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 481us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625244.163839:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 123 00010000:00010000:0.0:1788625244.235897:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625244.427994:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744186a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206190080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625244.427995:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206190208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625244.428115:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206190336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625244.429134:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625244.429420:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625244.429529:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625244.429636:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206190208 00000100:00100000:0.0:1788625244.429645:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206190208 00000100:00100000:0.0:1788625244.429707:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206190080 00000100:00100000:0.0:1788625244.429711:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206190080 00000100:00100000:0.0:1788625244.429729:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788625244.429738:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875509206190208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625244.429770:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625244.429823:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206190336 00000100:00100000:0.0:1788625244.429829:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875509206190208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625244.429830:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206190336 00000100:00100000:0.0:1788625244.429839:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788625244.429859:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788625244.429868:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206190080:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625244.429874:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00002000:00000024:0.0:1788625244.429880:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625244.429885:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206190336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625244.429914:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788625244.429917:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206190080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625244.429938:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788625244.429961:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206190336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625244.429968:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788625244.429992:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206190208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625244.430011:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744186a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206190080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625244.430788:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206190336:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788625244.556559:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788625244.556582:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788625244.561781:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788625244.561800:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788625244.561957:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744186a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1875509206190464:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788625244.562070:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842a87b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788625244.572987:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744186a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1875509206190464:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788625244.573114:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.573233:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185146240 00000100:00100000:2.0:1788625244.573241:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185146240 00000100:00100000:2.0:1788625244.573305:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 124 00000100:00100000:2.0:1788625244.573315:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11405:x1875509185146240:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788625244.573346:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788625244.573454:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11405:x1875509185146240:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 Request processed in 140us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625244.573462:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 124 00000100:00100000:1.0:1788625244.582335:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.583695:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185146368 00000100:00100000:2.0:1788625244.583714:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185146368 00000100:00100000:0.0:1788625244.583831:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 125 00000100:00100000:0.0:1788625244.583848:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11405:x1875509185146368:12345-192.168.204.14@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788625244.583935:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aba2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.583957:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aba2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.583970:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aba2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.583989:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7aba9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.583996:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7aba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584003:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7aba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584031:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7abb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584041:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7abb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584048:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7abb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625244.584130:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788625244.584135:0:11318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625244.584149:0:11318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7abb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584162:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aba2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584169:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aba2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584176:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aba2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584183:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625244.584189:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aba2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584197:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aba2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584211:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998743548200) 00010000:00010000:0.0:1788625244.584214:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625244.584220:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aba2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584226:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aba2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584244:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7aba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584618:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7aba9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584685:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7aba9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584692:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625244.584695:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7aba9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584702:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7aba9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584711:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9988749c3200) 00010000:00010000:0.0:1788625244.584714:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625244.584717:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7aba9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584722:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7aba9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584739:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7abb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584745:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7abb0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584751:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7abb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584756:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625244.584765:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7abb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584772:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7abb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584780:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:0.0:1788625244.584782:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625244.584786:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7abb0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.584792:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7abb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625244.584923:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11405:x1875509185146368:12345-192.168.204.14@tcp:34:lhsmtool_posix.0 Request processed in 1079us (2598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625244.584931:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 125 00000100:00100000:0.0:1788625244.594100:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625244.594293:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185146624 00000100:00100000:1.0:1788625244.594304:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185146624 00000100:00100000:1.0:1788625244.594370:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 126 00000100:00100000:1.0:1788625244.594379:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:11405:x1875509185146624:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625244.594402:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625244.594426:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7abb7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e212 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.594816:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.594831:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.594842:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625244.594852:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788625244.594932:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.594940:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abbe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.594947:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.594954:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625244.594958:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.594966:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.594978:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:1.0:1788625244.594980:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788625244.594985:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.595001:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.595042:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7abb7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e212 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.595052:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998743548200) 00010000:00010000:1.0:1788625244.595054:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625244.595058:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7abb7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e212 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.595066:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4600, rc 0) 00000100:00100000:1.0:1788625244.595124:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+62:11405:x1875509185146624:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 747us (1036us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1788625244.595132:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 126 00000100:00100000:1.0:1788625244.598767:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625244.599177:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185146752 00000100:00100000:0.0:1788625244.599189:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185146752 00000100:00100000:0.0:1788625244.599350:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 127 00000100:00100000:0.0:1788625244.599362:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+62:11405:x1875509185146752:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788625244.599400:0:9824:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788625244.599638:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+62:11405:x1875509185146752:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 Request processed in 269us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625244.599647:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 127 00000100:00100000:0.0:1788625244.609275:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625244.609346:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185147008 00000100:00100000:3.0:1788625244.609355:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185147008 00000100:00100000:3.0:1788625244.609415:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 128 00000100:00100000:3.0:1788625244.609425:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+62:11405:x1875509185147008:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625244.609448:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625244.609451:0:11318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788625244.609480:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7000/0x2d2e3b3f34a7ab5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1f6 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.609504:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:3.0:1788625244.609509:0:11318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625244.609590:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7abcc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e219 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788625244.610040:0:11318:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788625244.610182:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7abd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.610196:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7abd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.610205:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7abd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.610247:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7abcc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e219 expref: 64 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.610262:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7abd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e219 expref: 63 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.610270:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9988606b3600) 00010000:00010000:3.0:1788625244.610273:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625244.610275:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683600, rc 0) 00000100:00100000:3.0:1788625244.610337:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:11405:x1875509185147008:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 914us (1071us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788625244.610344:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 128 00000100:00100000:3.0:1788625244.614773:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625244.614929:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185147264 00000100:00100000:1.0:1788625244.614942:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185147264 00000100:00100000:1.0:1788625244.615061:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 129 00000100:00100000:1.0:1788625244.615073:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:11405:x1875509185147264:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788625244.615139:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625244.615167:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7abd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e219 expref: 63 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615193:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9988606b3600) 00010000:00010000:1.0:1788625244.615205:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625244.615244:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7abe1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615330:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7abe1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615342:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7abe1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615385:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abe8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x6cd66892 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615390:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6cd66892 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615395:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6cd66892 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615451:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7abe1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615458:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7abe1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615465:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7abe1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615472:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625244.615477:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7abe1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615484:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7abe1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615503:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:1.0:1788625244.615506:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625244.615510:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7abe1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615769:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7abe1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615780:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6cd66892 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615787:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abe8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6cd66892 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615793:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abe8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6cd66892 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615798:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625244.615801:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abe8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6cd66892 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615808:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abe8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6cd66892 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615816:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x6cd66892 (ffff9987410b7c00) 00010000:00010000:1.0:1788625244.615818:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625244.615822:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abe8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x6cd66892 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.615827:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7abe8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x6cd66892 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625244.615964:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+62:11405:x1875509185147264:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 893us (1203us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788625244.615972:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 129 00000100:00100000:0.0:1788625244.618963:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.619008:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185147392 00000100:00100000:2.0:1788625244.619023:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185147392 00000100:00100000:2.0:1788625244.619085:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 130 00000100:00100000:2.0:1788625244.619094:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+62:11405:x1875509185147392:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625244.619114:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625244.619136:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7abef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e220 expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.619172:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7abf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.619186:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7abf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.619211:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7abf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.619316:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7abef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e220 expref: 64 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.619333:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7abf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e220 expref: 63 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.619342:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9988625be700) 00010000:00010000:2.0:1788625244.619345:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788625244.619348:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744189a00, rc 0) 00000100:00100000:2.0:1788625244.619409:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:11405:x1875509185147392:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 316us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625244.619416:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 130 00000100:00100000:0.0:1788625244.623451:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.623588:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185147648 00000100:00100000:2.0:1788625244.623599:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185147648 00000100:00100000:2.0:1788625244.623666:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 131 00000100:00100000:2.0:1788625244.623678:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:11405:x1875509185147648:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788625244.623778:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7abfd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.623799:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7abfd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.623814:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7abfd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625244.624000:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788625244.624010:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365731492284ns, next at 366731489769ns, rc = 0 00000004:00010000:2.0:1788625244.624057:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004fcf42bd reply state 000000001bde1a3b transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7abfd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.624070:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7abfd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.624077:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9988625be700) 00010000:00010000:2.0:1788625244.624080:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788625244.624083:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625244.624167:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:11405:x1875509185147648:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 492us (725us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788625244.624174:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 131 00000100:00100000:3.0:1788625244.627669:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625244.627915:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185147776 00000100:00100000:1.0:1788625244.627925:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185147776 00000100:00100000:1.0:1788625244.627980:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 132 00000100:00100000:1.0:1788625244.627990:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:11405:x1875509185147776:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625244.628012:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625244.628030:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7ac04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e227 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.628085:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7ac04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e227 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.628100:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7ac04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e227 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.628117:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9988625be700) 00010000:00010000:1.0:1788625244.628120:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625244.628124:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4400, rc 0) 00000100:00100000:1.0:1788625244.628185:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+66:11405:x1875509185147776:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 197us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625244.628191:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 132 00000100:00100000:0.0:1788625244.631882:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625244.632147:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185147904 00000100:00100000:3.0:1788625244.632156:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185147904 00000100:00100000:3.0:1788625244.632272:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 45 00000100:00100000:3.0:1788625244.632287:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2391:x1875509185147904:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788625244.632595:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:2391:x1875509185147904:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 Request processed in 313us (721us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788625244.632603:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 45 00000100:00100000:0.0:1788625244.637887:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625244.637986:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185148160 00000100:00100000:1.0:1788625244.637997:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185148160 00000100:00100000:1.0:1788625244.638057:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 30 00000100:00100000:1.0:1788625244.638243:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+66:11405:x1875509185148160:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788625244.639281:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:11405:x1875509185148160:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 1196us (1400us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1788625244.639292:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 30 00000100:00100000:0.0:1788625244.643101:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.643586:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185148416 00000100:00100000:2.0:1788625244.643596:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185148416 00000100:00100000:2.0:1788625244.643664:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 133 00000100:00100000:2.0:1788625244.643674:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:11405:x1875509185148416:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788625244.643789:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:11405:x1875509185148416:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 116us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625244.643797:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 133 00000100:00100000:0.0:1788625244.652014:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625244.652123:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185148544 00000100:00100000:1.0:1788625244.652133:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185148544 00000100:00100000:1.0:1788625244.652247:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 134 00000100:00100000:1.0:1788625244.652258:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:11405:x1875509185148544:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625244.652289:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625244.652313:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7ac0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e22e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.652385:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7ac12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.652402:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7ac12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.652414:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7ac12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625244.652460:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625244.652479:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7ac12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.652504:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7ac0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e22e expref: 69 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.652544:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7ac12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e22e expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.652580:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9988625be700) 00010000:00010000:1.0:1788625244.652583:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788625244.652587:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4200, rc 0) 00000100:00100000:1.0:1788625244.652659:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+68:11405:x1875509185148544:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 403us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625244.652666:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 134 00000100:00100000:3.0:1788625244.655821:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625244.655982:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185148672 00000100:00100000:0.0:1788625244.655991:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185148672 00000100:00100000:0.0:1788625244.656051:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 46 00000100:00100000:0.0:1788625244.656061:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:2393:x1875509185148672:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625244.656079:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625244.656100:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b329e03/0x2d2e3b3f34a7ac19 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e235 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625244.656126:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c415b, blocks: 0x0 00010000:00010000:0.0:1788625244.656145:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1788625244.656150:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625244.656160:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b329e03/0x2d2e3b3f34a7ac19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e235 expref: 10 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.656179:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b329e03/0x2d2e3b3f34a7ac19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e235 expref: 10 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.656193:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994600, rc 0) 00000100:00100000:0.0:1788625244.656270:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:2393:x1875509185148672:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 198us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625244.656277:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 46 00000100:00100000:0.0:1788625244.662719:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625244.662823:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185148928 00000100:00100000:3.0:1788625244.662833:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185148928 00000100:00100000:3.0:1788625244.662894:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 135 00000100:00100000:3.0:1788625244.662904:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+68:11405:x1875509185148928:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788625244.663018:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+68:11405:x1875509185148928:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 115us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625244.663026:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 135 00000100:00100000:0.0:1788625244.669905:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.669996:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185149056 00000100:00100000:2.0:1788625244.670007:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185149056 00000100:00100000:2.0:1788625244.670066:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 47 00000100:00100000:2.0:1788625244.670076:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:11405:x1875509185149056:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625244.670097:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625244.670134:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7ac20 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e23c expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.670185:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b329e03/0x2d2e3b3f34a7ac19 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e235 expref: 11 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.670196:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625244.670200:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625244.670206:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7ac20 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e23c expref: 11 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.670241:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b329e03/0x2d2e3b3f34a7ac19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e235 expref: 11 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.670266:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b329e03/0x2d2e3b3f34a7ac19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e235 expref: 11 pid: 8423 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.670282:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8425:1875509206190592:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625244.670389:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da540 going to sleep for 11 seconds 00000100:00100000:2.0:1788625244.673794:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8425:1875509206190592:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625244.673836:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7ac20 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e23c expref: 11 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.673858:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188c00, rc 0) 00000100:00100000:2.0:1788625244.673919:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:11405:x1875509185149056:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 3844us (4023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625244.673944:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 47 00000100:00100000:0.0:1788625244.675478:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625244.675746:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185149184 00000100:00100000:1.0:1788625244.675754:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185149184 00010000:00010000:1.0:1788625244.675795:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b329e03/0x2d2e3b3f34a7ac19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e235 expref: 11 pid: 8423 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625244.675835:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 74 00000100:00100000:1.0:1788625244.675845:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:2393:x1875509185149184:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625244.675861:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625244.675883:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b329e03/0x2d2e3b3f34a7ac19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e235 expref: 11 pid: 8423 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.675898:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b329e03/0x2d2e3b3f34a7ac19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e235 expref: 11 pid: 8423 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.675925:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b329e03/0x2d2e3b3f34a7ac19 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e235 expref: 11 pid: 8423 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.675943:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625244.675960:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625244.675969:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7ac20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e23c expref: 10 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.675980:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7ac20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e23c expref: 10 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.676017:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7ac20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e23c expref: 10 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625244.676033:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744186680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6496:1875509206190720:192.168.204.14@tcp:105: 00000100:00100000:1.0:1788625244.676126:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842a87e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625244.680365:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744186680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6496:1875509206190720:192.168.204.14@tcp:105: 00010000:00010000:1.0:1788625244.680400:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625244.680472:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:2393:x1875509185149184:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 4627us (5001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625244.680485:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 74 00000100:00100000:3.0:1788625244.685435:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.685570:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185149312 00000100:00100000:2.0:1788625244.685582:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185149312 00002000:00100000:2.0:1788625244.685650:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff998858357100 x1875509185149312/t0(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:55/0 lens 504/0 e 0 to 0 dl 1788625255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788625244.685662:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998858357100 with x1875509185149312 ext(0->12) 00002000:00010000:2.0:1788625244.685668:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff998858357100 00000100:00100000:2.0:1788625244.685701:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 2 00000100:00100000:2.0:1788625244.685710:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:2393:x1875509185149312:12345-192.168.204.14@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788625244.686827:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+12:2393:x1875509185149312:12345-192.168.204.14@tcp:4:lhsmtool_posix.0 Request processed in 1112us (1400us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788625244.686839:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 2 00002000:00100000:2.0:1788625244.686848:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff998858357100 x1875509185149312/t4294967309(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:55/0 lens 504/448 e 0 to 0 dl 1788625255 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788625244.686857:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998858357100 with x1875509185149312 ext(0->12) 00002000:00010000:2.0:1788625244.686861:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff998858357100 00000100:00100000:0.0:1788625244.689753:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.689871:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185149440 00000100:00100000:2.0:1788625244.689880:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185149440 00000100:00100000:2.0:1788625244.689980:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 136 00000100:00100000:2.0:1788625244.689990:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+68:11405:x1875509185149440:12345-192.168.204.14@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788625244.691924:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1788625244.691940:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788625244.692049:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788625244.692074:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff998842a87840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788625244.692078:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99887259b200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff998842a879c0 00000020:00080000:0.0:1788625244.692082:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99887259b800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff998742ea5200 00000004:00080000:0.0:1788625244.692112:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:1.0:1788625244.692164:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a925 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692177:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a925 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692185:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a925 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.692189:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788625244.692193:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625244.692199:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a925 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.692211:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206190848:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788625244.692222:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a925 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692243:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9988606b3500) 00010000:00010000:1.0:1788625244.692247:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625244.692252:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a925 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692259:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6400/0x2d2e3b3f34a7a925 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692294:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a9cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.692308:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788625244.692314:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a9cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692322:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a9cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692327:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625244.692330:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a9cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692340:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a9cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692349:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9988749c3400) 00010000:00010000:1.0:1788625244.692352:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625244.692355:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a9cd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692382:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7a9cd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.692386:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206190848 00000100:00100000:2.0:1788625244.692394:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206190848 00010000:00010000:1.0:1788625244.692405:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa4b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692413:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa4b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692420:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa4b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692425:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625244.692428:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa4b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692435:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa4b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.692442:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1788625244.692447:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988625be000) 00010000:00010000:1.0:1788625244.692452:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625244.692456:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1875509206190848:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788625244.692457:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa4b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692469:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7600/0x2d2e3b3f34a7aa4b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692480:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692487:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa6e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788625244.692488:0:8423:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1788625244.692502:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692508:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac6a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625244.692511:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625244.692553:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c415a, atime: 0x6a9c415a, ctime: 0x6a9c415a, blocks: 0x8 00010000:00010000:1.0:1788625244.692556:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa6e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.692574:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4eb962/0x2d2e3b3f34a7ac27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692578:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988625be000) 00010000:00010000:1.0:1788625244.692584:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625244.692589:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa6e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.692594:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=365s v=(0 0) 00010000:00010000:1.0:1788625244.692598:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6a00/0x2d2e3b3f34a7aa6e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.692601:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625244.692614:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4eb962/0x2d2e3b3f34a7ac27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692626:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692634:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692643:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.692644:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd4eb962/0x2d2e3b3f34a7ac27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692658:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625244.692664:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.692665:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4eb962/0x2d2e3b3f34a7ac27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.692679:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4eb962/0x2d2e3b3f34a7ac27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692696:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.692710:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625244.692710:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:1.0:1788625244.692716:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625244.692719:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab40 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692726:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7200/0x2d2e3b3f34a7ab40 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692738:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7abfd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692759:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7abfd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692765:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7abfd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692771:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625244.692774:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7abfd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692780:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7abfd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692788:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9988625be700) 00010000:00010000:1.0:1788625244.692791:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788625244.692794:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7abfd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.692810:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7abfd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788625244.692857:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788625244.692858:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1875509206190848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 404us (548us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788625244.692869:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1788625244.692899:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625244.692905:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd4eb962/0x2d2e3b3f34a7ac27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.692913:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188600 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625244.692918:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4eb962/0x2d2e3b3f34a7ac27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.692926:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4eb962/0x2d2e3b3f34a7ac27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.692939:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd4eb962/0x2d2e3b3f34a7ac27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.692946:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd4eb962/0x2d2e3b3f34a7ac27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.692961:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625244.692963:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625244.692964:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788625244.692997:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9987441b8a80/2, rc 0, transno 4294967305 00000100:00100000:2.0:1788625244.693003:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206190848:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788625244.695899:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206190976:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788625244.695981:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625244.696039:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625244.696046:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206191104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788625244.696070:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625244.696112:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206190976 00000100:00100000:1.0:1788625244.696121:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206190976 00000100:00100000:1.0:1788625244.696170:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206191104 00000100:00100000:1.0:1788625244.696173:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206191104 00000100:00100000:1.0:1788625244.696189:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788625244.696197:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3635:x1875509206190976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788625244.696225:0:8868:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:1.0:1788625244.696254:0:8868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7ac2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.696279:0:8868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4604636/0x2d2e3b3f34a7a9db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e194 expref: 11 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.696289:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788625244.696294:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788625244.696298:0:8868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7ac2e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.696377:0:8868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4604636/0x2d2e3b3f34a7a9db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e194 expref: 11 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.696393:0:8868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4604636/0x2d2e3b3f34a7a9db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e194 expref: 11 pid: 8424 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625244.696407:0:8868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744050a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8868:1875509206191232:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625244.696475:0:8868:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842a87b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625244.696493:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788625244.696501:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1875509206191104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788625244.696645:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788625244.696649:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788625243 00002000:00010000:1.0:1788625244.696651:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788625244.696654:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788625243 -> 1788625243 00002000:00010000:1.0:1788625244.696656:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000020:00080000:0.0:1788625244.697027:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9987437da0c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788625244.697034:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99874395c100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9987437dac00 00000020:00080000:0.0:1788625244.697037:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99874395c700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff998860865400 00000020:00080000:0.0:1788625244.697059:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1788625244.697439:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788625244.697503:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788625244.698249:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:11405:x1875509185149440:12345-192.168.204.14@tcp:44:lhsmtool_posix.0 Request processed in 8254us (8501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625244.698261:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 136 00000100:00100000:3.0:1788625244.699610:0:8868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744050a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8868:1875509206191232:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625244.699647:0:8868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7ac2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.699810:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625244.699952:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185149568 00000100:00100000:3.0:1788625244.699960:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185149568 00010000:00010000:3.0:1788625244.700009:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4604636/0x2d2e3b3f34a7a9db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e194 expref: 12 pid: 8424 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625244.700048:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 75 00000100:00100000:3.0:1788625244.700057:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+12:2394:x1875509185149568:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625244.700072:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625244.700090:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4604636/0x2d2e3b3f34a7a9db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e194 expref: 12 pid: 8424 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.700104:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4604636/0x2d2e3b3f34a7a9db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e194 expref: 12 pid: 8424 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.700129:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4604636/0x2d2e3b3f34a7a9db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e194 expref: 12 pid: 8424 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.700149:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625244.700154:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625244.700160:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7ac2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.700171:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7ac2e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.700199:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625244.700250:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:2394:x1875509185149568:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 194us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625244.700258:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 75 00010000:00010000:3.0:1788625244.700283:0:8868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7ac2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.700292:0:8868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7ac2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.700943:0:8868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7ac2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.700952:0:8868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7ac2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.700970:0:8868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788625244.701142:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3635:x1875509206190976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4944us (5160us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788625244.701150:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:3.0:1788625244.701173:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625244.701180:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7ac2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.701188:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5600 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625244.701192:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7ac2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.701202:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7ac2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.701217:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7ac2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.701226:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7ac2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.701255:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625244.701257:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625244.701258:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788625244.701292:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff998858354e00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788625244.701299:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206190976:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788625244.701574:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3635:x1875509206191104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5072us (5501us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788625244.701582:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1788625244.701725:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9987439c7b80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788625244.701731:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206191104:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788625244.701941:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625244.702180:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185149696 00000100:00100000:3.0:1788625244.702186:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185149696 00000100:00100000:3.0:1788625244.702253:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 51 00000100:00100000:3.0:1788625244.702262:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:2394:x1875509185149696:12345-192.168.204.14@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788625244.704229:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1788625244.704244:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1788625244.704570:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185149696:12345-192.168.204.14@tcp:16:lhsmtool_posix.0 Request processed in 2293us (2614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625244.704583:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 51 00000100:00100000:2.0:1788625244.719755:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625244.719903:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185149952 00000100:00100000:1.0:1788625244.719913:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185149952 00000100:00100000:1.0:1788625244.719976:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 137 00000100:00100000:1.0:1788625244.719987:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:11405:x1875509185149952:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788625244.720062:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625244.720092:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7ac12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e22e expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.720111:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9988625be700) 00010000:00010000:1.0:1788625244.720117:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625244.720147:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ac35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.720160:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ac35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.720170:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ac35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625244.720285:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008b38ff6 reply state 00000000cf885fb1 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ac35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.720296:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ac35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.720303:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9988625be700) 00010000:00010000:1.0:1788625244.720305:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788625244.720307:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625244.720419:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+17:11405:x1875509185149952:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 433us (683us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1788625244.720427:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 137 00000100:00100000:0.0:1788625244.730713:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625244.733849:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185150080 00000100:00100000:3.0:1788625244.733865:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185150080 00000100:00100000:0.0:1788625244.734251:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 52 00000100:00100000:0.0:1788625244.734263:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185150080:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788625244.734465:0:8868:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788625244.734469:0:8868:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788625243 -> 1788625242 00002000:00010000:0.0:1788625244.734472:0:8868:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788625242 00002000:00010000:0.0:1788625244.734474:0:8868:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788625243 -> 1788625242 00002000:00010000:0.0:1788625244.734476:0:8868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788625244.734581:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2394:x1875509185150080:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 Request processed in 319us (3877us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788625244.734606:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 52 00000100:00100000:0.0:1788625244.747342:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.748094:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185150336 00000100:00100000:2.0:1788625244.748107:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185150336 00000100:00100000:2.0:1788625244.748184:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 138 00000100:00100000:2.0:1788625244.748195:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+17:11405:x1875509185150336:12345-192.168.204.14@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788625244.748268:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7ac3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.748285:0:9824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7abf6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e220 expref: 17 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.748295:0:9824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7ac3c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.748330:0:9824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7abf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e220 expref: 17 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.748344:0:9824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7abf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e220 expref: 17 pid: 9824 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.748359:0:9824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9824:1875509206191360:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625244.748573:0:9824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da540 going to sleep for 11 seconds 00000100:00100000:2.0:1788625244.762182:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625244.762330:0:9824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9824:1875509206191360:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625244.762365:0:9824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7ac3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625244.764296:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185150464 00000100:00100000:3.0:1788625244.764374:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185150464 00010000:00010000:0.0:1788625244.764535:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7abf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e220 expref: 18 pid: 9824 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625244.764636:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 76 00000100:00100000:0.0:1788625244.764647:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:2394:x1875509185150464:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625244.764662:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625244.764670:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7abf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e220 expref: 18 pid: 9824 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.764685:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7abf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e220 expref: 18 pid: 9824 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.764710:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7abf6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e220 expref: 18 pid: 9824 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.764727:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9988625be700) 00010000:00010000:0.0:1788625244.764732:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7ac3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.765051:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7ac3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.765074:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7ac3c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.765107:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625244.765218:0:9824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7ac3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.765228:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7ac3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.765281:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7ac3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.765289:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7ac3c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.765295:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7ac3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.765311:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625244.765317:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7ac3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.765325:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7ac3c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.765336:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9988625be700) 00010000:00010000:2.0:1788625244.765342:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788625244.765346:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7ac3c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.765352:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7ac3c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.765445:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+17:11405:x1875509185150336:12345-192.168.204.14@tcp:55:lhsmtool_posix.0 Request processed in 17251us (18111us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788625244.765455:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 138 00000100:00100000:0.0:1788625244.767070:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:2394:x1875509185150464:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 2329us (4805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625244.767083:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 76 00000100:00100000:2.0:1788625244.769596:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625244.769935:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185150592 00000100:00100000:3.0:1788625244.769946:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185150592 00000100:00100000:3.0:1788625244.770013:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 53 00000100:00100000:3.0:1788625244.770024:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998874f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2394:x1875509185150592:12345-192.168.204.14@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788625244.770074:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7ac43 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.770114:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7ac20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e23c expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.770133:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625244.770137:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625244.770141:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7ac43 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.770180:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7ac20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e23c expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.770197:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7ac20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e23c expref: 7 pid: 8425 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625244.770213:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1875509206191488:192.168.204.14@tcp:104: 00000100:00100000:3.0:1788625244.770835:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988607e9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788625244.777805:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1875509206191488:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625244.777837:0:8423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7ac43 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.781237:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625244.781416:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185150720 00000100:00100000:1.0:1788625244.781426:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185150720 00010000:00010000:1.0:1788625244.781469:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7ac20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e23c expref: 8 pid: 8425 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625244.781552:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 77 00000100:00100000:1.0:1788625244.781574:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2393:x1875509185150720:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625244.781590:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625244.781613:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7ac20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e23c expref: 8 pid: 8425 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.781628:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7ac20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e23c expref: 8 pid: 8425 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.781652:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7ac20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e23c expref: 8 pid: 8425 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.781669:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788625244.781673:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788625244.781679:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7ac43 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.781688:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7ac43 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625244.781729:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625244.781793:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185150720:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 221us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625244.781800:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 77 00010000:00010000:2.0:1788625244.782105:0:8423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7ac43 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.782123:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7ac43 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.782144:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7ac43 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.782153:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7ac43 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.782161:0:8423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7ac43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.782167:0:8423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625244.782172:0:8423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7ac43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.782180:0:8423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7ac43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.782193:0:8423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7ac43 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.782200:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7ac43 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.782260:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998874f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185150592:12345-192.168.204.14@tcp:1:lhsmtool_posix.0 Request processed in 12237us (12672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625244.782267:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 53 00000100:00100000:2.0:1788625244.792801:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625244.795442:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185150976 00000100:00100000:0.0:1788625244.795462:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185150976 00000100:00100000:0.0:1788625244.795636:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 139 00000100:00100000:0.0:1788625244.795650:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:11405:x1875509185150976:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788625244.795742:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.795761:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7ab39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e8 expref: 16 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.795772:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac4a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.795807:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7ab39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e8 expref: 16 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.795822:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7ab39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e8 expref: 16 pid: 9824 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625244.795836:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206191616:192.168.204.14@tcp:104: 00000100:00100000:0.0:1788625244.795953:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625244.799027:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.799439:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185151104 00000100:00100000:2.0:1788625244.799449:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185151104 00010000:00010000:2.0:1788625244.799494:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7ab39 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e8 expref: 17 pid: 9824 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.799579:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 78 00000100:00100000:2.0:1788625244.799589:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+17:2393:x1875509185151104:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625244.799603:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625244.799610:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7ab39 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e8 expref: 17 pid: 9824 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.799634:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7ab39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e8 expref: 17 pid: 9824 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.799659:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625244.799665:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e20b expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.799676:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.799685:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.799707:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac4a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.799728:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625244.799782:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+17:2393:x1875509185151104:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 194us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625244.799789:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 78 00010000:00010000:0.0:1788625244.800660:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7e00/0x2d2e3b3f34a7ab39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e1e8 expref: 16 pid: 9824 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625244.800680:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206191616:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625244.800702:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.800711:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.800717:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.800883:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac51 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.800896:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7ac04 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e227 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.800904:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac51 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.800934:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7ac04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e227 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.800948:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7ac04 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e227 expref: 16 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625244.800961:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206191744:192.168.204.14@tcp:104: 00000100:00100000:0.0:1788625244.801046:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788625244.803836:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206191744:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625244.803867:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac51 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.809565:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625244.809653:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185151232 00000100:00100000:0.0:1788625244.809663:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185151232 00010000:00010000:0.0:1788625244.809704:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7ac04 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e227 expref: 17 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625244.809749:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 79 00000100:00100000:0.0:1788625244.809759:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+17:2393:x1875509185151232:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625244.809775:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625244.809782:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7ac04 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e227 expref: 17 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.809796:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7ac04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e227 expref: 17 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.809820:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7ac04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e227 expref: 17 pid: 6513 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.809837:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9988625be700) 00010000:00010000:0.0:1788625244.809842:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac51 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.809852:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.809877:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac51 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.809909:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625244.809969:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:2393:x1875509185151232:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 210us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625244.809976:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 79 00010000:00010000:2.0:1788625244.810168:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.810177:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625244.810295:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1788625244.810412:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1788625244.810448:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1788625244.810583:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1875509206191872:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788625244.810803:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625244.810837:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da000 going to sleep for 11 seconds 00000100:00100000:1.0:1788625244.810898:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206191872 00000100:00100000:1.0:1788625244.810903:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206191872 00000100:00100000:1.0:1788625244.810944:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788625244.810952:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1875509206191872:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788625244.811038:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1875509206191872:12345-0@lo:1000:mdt00_001.0 Request processed in 87us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625244.811044:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788625244.811107:0:6512:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788625244.811113:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:0.0:1788625244.811135:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9987439c7b80, transno 4294967310 00000004:00080000:0.0:1788625244.811151:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff998858354e00, transno 4294967311 00000100:00100000:0.0:1788625244.811159:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1875509206191872:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788625244.811283:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1788625244.811326:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1875509206192000:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788625244.811368:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625244.811384:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625244.811472:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206192000 00000100:00100000:1.0:1788625244.811476:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206192000 00000100:00100000:1.0:1788625244.811492:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788625244.811498:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1875509206192000:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788625244.811619:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6512:x1875509206192000:12345-0@lo:1000:mdt00_001.0 Request processed in 120us (250us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788625244.811720:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1875509206192000:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788625244.811747:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.811756:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac51 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.811763:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac51 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.811769:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625244.811772:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac51 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.811788:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac51 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.811800:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9988625be700) 00010000:00010000:0.0:1788625244.811803:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625244.811807:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac51 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.811813:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac51 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.811838:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.811845:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab94 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.811851:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab94 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.811855:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625244.811858:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab94 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.811864:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab94 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.811870:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:0.0:1788625244.811872:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625244.811878:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e20b expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.811898:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab9b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e20b expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.811907:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab9b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e20b expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.811929:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab9b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e20b expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625244.811939:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206192128:192.168.204.14@tcp:105: 00000100:00100000:0.0:1788625244.811983:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625244.812021:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788625244.824893:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206192128:192.168.204.14@tcp:105: 00010000:00010000:0.0:1788625244.824929:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab94 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.824940:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ab94 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.824995:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac58 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825013:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825025:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825036:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825059:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac58 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825065:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825071:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625244.825075:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825083:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac58 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825096:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:0.0:1788625244.825099:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625244.825102:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac58 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825109:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7ac58 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825122:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825129:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac4a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825142:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825147:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625244.825156:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825163:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac4a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825171:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:0.0:1788625244.825174:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788625244.825177:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac4a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.825183:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac4a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625244.825512:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788625244.825568:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788625244.826066:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788625244.826083:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788625244.826678:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:11405:x1875509185150976:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 31025us (33881us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788625244.826690:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 139 00000020:00080000:0.0:1788625244.826696:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788625244.833323:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625244.833572:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185151360 00000100:00100000:1.0:1788625244.833583:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185151360 00000100:00100000:1.0:1788625244.833648:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 31 00000100:00100000:1.0:1788625244.833658:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:11404:x1875509185151360:12345-192.168.204.14@tcp:49:lfs.0 00000100:00100000:1.0:1788625244.833780:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:11404:x1875509185151360:12345-192.168.204.14@tcp:49:lfs.0 Request processed in 123us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625244.833788:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 31 00000100:00100000:1.0:1788625244.842733:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625244.842784:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625244.842917:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185151616 00000100:00100000:3.0:1788625244.842927:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185151616 00000100:00100000:3.0:1788625244.842991:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 140 00000100:00100000:3.0:1788625244.843002:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:11404:x1875509185151616:12345-192.168.204.14@tcp:58:lfs.0 00000040:00080000:3.0:1788625244.843213:0:11318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788625244.843312:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:11404:x1875509185151616:12345-192.168.204.14@tcp:58:lfs.0 Request processed in 312us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625244.843320:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 140 00000100:00100000:0.0:1788625244.845373:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185151872 00000100:00100000:0.0:1788625244.845385:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185151872 00000100:00100000:0.0:1788625244.847193:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 32 00000100:00100000:0.0:1788625244.847214:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844c51450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:11405:x1875509185151872:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788625244.847494:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788625244.847694:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1788625244.847734:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.847751:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.847763:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.847785:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac5f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.847791:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac5f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.847797:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.847854:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788625244.847949:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844c51450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:11405:x1875509185151872:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 743us (5163us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788625244.847958:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 32 00000020:00080000:0.0:1788625244.847963:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788625244.849764:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625244.849778:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac5f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.849787:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625244.849792:0:10330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac5f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.849803:0:10330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.849821:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9988625be700) 00010000:00010000:3.0:1788625244.849824:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788625244.849829:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac5f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.849835:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac5f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.849858:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625244.849860:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625244.849862:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625244.875822:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.878403:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185152000 00000100:00100000:2.0:1788625244.878419:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185152000 00000100:00100000:2.0:1788625244.878718:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 141 00000100:00100000:2.0:1788625244.878733:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:11407:x1875509185152000:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625244.878758:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625244.878781:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7ac66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e243 expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.878869:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7ac6d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.878885:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7ac6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.878897:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7ac6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.878913:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7ac74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.878920:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7ac74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.878927:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7ac74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.879008:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ac7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.879026:0:9824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e204 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.879035:0:9824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ac7b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.879078:0:9824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e204 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625244.879112:0:9824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e204 expref: 22 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625244.879127:0:9824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9824:1875509206192256:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625244.879264:0:9824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988607fdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625244.881919:0:9824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9824:1875509206192256:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625244.881952:0:9824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ac7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625244.882428:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625244.882736:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185152256 00000100:00100000:2.0:1788625244.882744:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185152256 00000100:00100000:2.0:1788625244.882802:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 33 00000100:00100000:2.0:1788625244.882812:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+23:6162:x1875509185152256:12345-192.168.204.14@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788625244.883026:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:6162:x1875509185152256:12345-192.168.204.14@tcp:35:ldlm_bl.0 Request processed in 215us (600us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788625244.883035:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 33 00000100:00100000:2.0:1788625244.887936:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625244.888024:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185152384 00000100:00100000:3.0:1788625244.888033:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185152384 00010000:00010000:3.0:1788625244.888076:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e204 expref: 24 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625244.888118:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 80 00000100:00100000:3.0:1788625244.888127:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:2393:x1875509185152384:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625244.888140:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625244.888146:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e204 expref: 24 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.888160:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e204 expref: 24 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.888191:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188e00/0x2d2e3b3f34a7ab86 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e204 expref: 24 pid: 6512 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.888208:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:3.0:1788625244.888213:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ac7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.888223:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ac7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.888231:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ac7b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625244.888260:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625244.888321:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+23:2393:x1875509185152384:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 195us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625244.888345:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 80 00010000:00010000:0.0:1788625244.888418:0:9824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ac7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888427:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ac7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625244.888487:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788625244.888492:0:9824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625244.888513:0:9824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ac7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888580:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ac7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888596:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7ac6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888603:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7ac6d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888609:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7ac6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888614:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625244.888628:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7ac6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888636:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7ac6d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888653:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:0.0:1788625244.888656:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625244.888660:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7ac6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888666:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7ac6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888677:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7ac74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888683:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7ac74 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888688:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7ac74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888698:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625244.888701:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7ac74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888707:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7ac74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888714:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9988625be900) 00010000:00010000:0.0:1788625244.888717:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625244.888720:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7ac74 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888725:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7ac74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888762:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7ac66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e243 expref: 23 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888775:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ac7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e243 expref: 22 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625244.888781:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:0.0:1788625244.888783:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625244.888785:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744189800, rc 0) 00000100:00100000:0.0:1788625244.888811:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:11407:x1875509185152000:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 10084us (13001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625244.888818:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 141 00010000:00010000:2.0:1788625245.262797:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625245.560015:0:14304:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788625245.560027:0:14304:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788625245.560061:0:14304:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788625245.560068:0:14304:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788625245.838407:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788625245.838419:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788625245.838446:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788625245.838458:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788625245.838633:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1875509206192384:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788625245.838780:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988607e99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625245.845302:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1875509206192384:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788625245.847873:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625245.847948:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185152512 00000100:00100000:2.0:1788625245.847957:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185152512 00000100:00080000:0.0:1788625245.848041:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625245.848239:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 142 00000100:00100000:2.0:1788625245.848254:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:11419:x1875509185152512:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788625245.848401:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788625245.848856:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:11419:x1875509185152512:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 Request processed in 604us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625245.848865:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 142 00000100:00100000:2.0:1788625245.855348:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625245.855486:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185152768 00000100:00100000:1.0:1788625245.855509:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185152768 00000100:00100000:1.0:1788625245.855621:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 143 00000100:00100000:1.0:1788625245.855632:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:11419:x1875509185152768:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625245.855655:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625245.855677:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7ac82 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e24a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625245.855789:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ac89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625245.855805:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ac89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625245.855818:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ac89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625245.855831:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788625245.855944:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7ac82 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e24a expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625245.855963:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ac89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e24a expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625245.855972:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:1.0:1788625245.855975:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625245.855979:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5a00, rc 0) 00000100:00100000:1.0:1788625245.856045:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:11419:x1875509185152768:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 415us (709us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788625245.856052:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 143 00000100:00100000:3.0:1788625245.863442:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625245.863633:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185152896 00000100:00100000:0.0:1788625245.863644:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185152896 00000100:00100000:0.0:1788625245.863710:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:0.0:1788625245.863721:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:2392:x1875509185152896:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625245.863738:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625245.863764:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ac89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e24a expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625245.863786:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:0.0:1788625245.863791:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625245.863853:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+23:2392:x1875509185152896:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 134us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625245.863861:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:0.0:1788625245.866602:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625245.867801:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185153152 00000100:00100000:2.0:1788625245.867840:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185153152 00000100:00100000:2.0:1788625245.867916:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 144 00000100:00100000:2.0:1788625245.867927:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+23:11419:x1875509185153152:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788625245.868014:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7ac97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625245.868033:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7ac97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625245.868044:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7ac97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625245.868218:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7ac97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625245.868226:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7ac97 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625245.868232:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7ac97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625245.868237:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625245.868241:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7ac97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625245.868248:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7ac97 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625245.868260:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625245.868263:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788625245.868268:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7ac97 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625245.868286:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7ac97 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625245.868427:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:11419:x1875509185153152:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 501us (1834us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788625245.868436:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 144 00000040:00080000:3.0:1788625245.868648:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788625245.868654:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788625245.869975:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788625245.869992:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788625245.874611:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625245.874716:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185153408 00000100:00100000:0.0:1788625245.874726:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185153408 00000100:00100000:0.0:1788625245.874786:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 34 00000100:00100000:0.0:1788625245.874798:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:11419:x1875509185153408:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788625245.875081:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+25:11419:x1875509185153408:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 284us (479us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788625245.875091:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 34 00000100:00100000:1.0:1788625246.206215:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625246.206281:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625246.206318:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625246.206413:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625246.206463:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185153664 00000100:00100000:1.0:1788625246.206468:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185153536 00000100:00100000:2.0:1788625246.206475:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185153664 00000100:00100000:1.0:1788625246.206476:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185153536 00000100:00100000:2.0:1788625246.206577:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185154176 00000100:00100000:2.0:1788625246.206581:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185154176 00000100:00100000:1.0:1788625246.206585:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 381 00000100:00100000:1.0:1788625246.206600:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2394:x1875509185153536:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625246.206620:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 283 00000100:00100000:2.0:1788625246.206630:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+25:2394:x1875509185153664:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625246.206756:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 284 00000100:00100000:0.0:1788625246.206766:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185154176:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625246.206825:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+25:2394:x1875509185153664:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 196us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625246.206832:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 283 00000100:00100000:3.0:1788625246.207024:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185153920 00000100:00100000:3.0:1788625246.207030:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185153920 00000100:00100000:3.0:1788625246.207065:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 108 00000100:00100000:3.0:1788625246.207074:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2394:x1875509185153920:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625246.207211:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2394:x1875509185153536:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 614us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625246.207219:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 381 00000100:00100000:0.0:1788625246.207256:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185154176:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 490us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625246.207264:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 284 00000100:00080000:0.0:1788625246.207287:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625246.207291:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625246.207341:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2394:x1875509185153920:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 267us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625246.207350:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 108 00000100:00100000:2.0:1788625246.207662:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625246.207715:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185153792 00000100:00100000:0.0:1788625246.207720:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185153792 00000100:00100000:2.0:1788625246.207761:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625246.207788:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625246.207813:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185154304 00000100:00100000:2.0:1788625246.207820:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185154304 00000100:00100000:1.0:1788625246.207850:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185154048 00000100:00100000:1.0:1788625246.207856:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185154048 00000100:00100000:0.0:1788625246.208242:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 285 00000100:00100000:0.0:1788625246.208254:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185153792:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625246.208402:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 286 00000100:00100000:2.0:1788625246.208410:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185154304:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625246.208443:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185154304:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 35us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625246.208716:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185153792:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 463us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625246.208723:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 285 00000100:00100000:2.0:1788625246.208867:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 286 00000100:00100000:1.0:1788625246.210512:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 109 00000100:00100000:1.0:1788625246.210751:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185154048:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625246.210926:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185154048:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 184us (3163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625246.210935:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 109 00000100:00080000:3.0:1788625246.215829:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625246.215840:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788625246.283718:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625247.308711:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788625247.321748:0:14355:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788625247.321757:0:14355:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625247.321788:0:14355:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788625247.321794:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788625247.438196:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625247.438405:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185154560 00000100:00100000:0.0:1788625247.438417:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185154560 00000100:00100000:0.0:1788625247.438543:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 145 00000100:00080000:3.0:1788625247.438545:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625247.438556:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+25:11440:x1875509185154560:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:0.0:1788625247.438582:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625247.438611:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e251 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625247.438730:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aca5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625247.438745:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aca5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625247.438757:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aca5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625247.438776:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788625247.438882:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994400/0x2d2e3b3f34a7ac9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e251 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625247.438905:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aca5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e251 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625247.438915:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:0.0:1788625247.438918:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788625247.438922:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994800, rc 0) 00000100:00100000:0.0:1788625247.439007:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+27:11440:x1875509185154560:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 455us (822us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788625247.439015:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 145 00000100:00100000:0.0:1788625247.444947:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625247.445101:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185154688 00000100:00100000:1.0:1788625247.445111:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185154688 00000100:00100000:1.0:1788625247.445187:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 146 00000100:00100000:1.0:1788625247.445200:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+27:11440:x1875509185154688:12345-192.168.204.14@tcp:54:lfs.0 00010000:00010000:1.0:1788625247.445276:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7acb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625247.445299:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7acb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625247.445497:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7acb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625247.445655:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7acb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625247.445663:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7acb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625247.445671:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7acb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625247.445678:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625247.445682:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7acb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625247.445690:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7acb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625247.445704:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:1.0:1788625247.445708:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625247.445713:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7acb3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625247.445719:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7acb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625247.445795:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+27:11440:x1875509185154688:12345-192.168.204.14@tcp:54:lfs.0 Request processed in 596us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625247.445804:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 146 00000100:00100000:3.0:1788625247.518122:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625247.518279:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185154816 00000100:00100000:0.0:1788625247.518293:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185154816 00000100:00100000:0.0:1788625247.518375:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 54 00000100:00100000:0.0:1788625247.518388:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185154816:12345-192.168.204.14@tcp:101:cat.0 00010000:00010000:0.0:1788625247.518419:0:8868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625247.518452:0:8868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dec43314/0x2d2e3b3f34a7acba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e258 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625247.518489:0:8868:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c415a, atime: 0x6a9c415a, ctime: 0x6a9c415a, blocks: 0x8 00010000:00010000:0.0:1788625247.518607:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=368s v=(0 0) 00010000:00010000:0.0:1788625247.518613:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625247.518624:0:8868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dec43314/0x2d2e3b3f34a7acba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e258 expref: 7 pid: 8868 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625247.518674:0:8868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dec43314/0x2d2e3b3f34a7acba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e258 expref: 7 pid: 8868 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625247.518692:0:8868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c994400, rc 0) 00000100:00100000:0.0:1788625247.518787:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2394:x1875509185154816:12345-192.168.204.14@tcp:101:cat.0 Request processed in 401us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625247.518795:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 54 00000100:00100000:3.0:1788625247.522016:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625247.522143:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185154944 00000100:00100000:1.0:1788625247.522176:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185154944 00002000:00100000:1.0:1788625247.522252:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9987439c5c00 x1875509185154944/t0(0) o3->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:58/0 lens 488/0 e 0 to 0 dl 1788625258 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625247.522278:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9987439c5c00 with x1875509185154944 ext(0->4095) 00002000:00010000:1.0:1788625247.522285:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9987439c5c00 00000100:00100000:1.0:1788625247.522321:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:1.0:1788625247.522331:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185154944:12345-192.168.204.14@tcp:3:cat.0 00000100:00100000:1.0:1788625247.522840:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185154944:12345-192.168.204.14@tcp:3:cat.0 Request processed in 508us (839us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788625247.522850:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 3 00002000:00100000:1.0:1788625247.522858:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9987439c5c00 x1875509185154944/t0(0) o3->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:58/0 lens 488/4536 e 0 to 0 dl 1788625258 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625247.522868:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9987439c5c00 with x1875509185154944 ext(0->4095) 00002000:00010000:1.0:1788625247.522872:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9987439c5c00 00000100:00100000:2.0:1788625248.013067:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206192512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625248.013159:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625248.013295:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206192512 00000100:00100000:1.0:1788625248.013311:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206192512 00000100:00100000:1.0:1788625248.013395:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788625248.013408:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206192512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788625248.013987:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788625248.014088:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206192512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 680us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625248.014098:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788625248.014179:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206192512:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788625248.332172:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625248.524689:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206192640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625248.524766:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625248.524853:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206192640 00000100:00100000:0.0:1788625248.524861:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206192640 00000100:00080000:2.0:1788625248.524926:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625248.524928:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788625248.524939:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875509206192640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625248.524968:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625248.525021:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875509206192640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625248.525028:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788625248.525102:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206192640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625248.525859:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206192768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625248.525898:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625248.525937:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206192768 00000100:00100000:0.0:1788625248.525941:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206192768 00000100:00100000:0.0:1788625248.525976:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788625248.525985:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206192768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625248.525999:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625248.526041:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206192768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625248.526054:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1788625248.526070:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625248.526095:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206192768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625249.035925:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206193152:0@lo:400:kworker.0 00000100:00100000:3.0:1788625249.035951:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206193280:0@lo:400:kworker.0 00000100:00100000:0.0:1788625249.036033:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206192896:0@lo:400:kworker.0 00000100:00100000:1.0:1788625249.036125:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206193024:0@lo:400:kworker.0 00000100:00100000:2.0:1788625249.037772:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625249.037843:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206193664:0@lo:400:kworker.0 00000100:00100000:2.0:1788625249.037878:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625249.037908:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206194176:0@lo:400:kworker.0 00000100:00100000:2.0:1788625249.037932:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625249.037985:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206193152 00000100:00100000:2.0:1788625249.037995:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206193152 00000100:00100000:2.0:1788625249.038054:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788625249.038064:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206193152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625249.038125:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206193152:12345-0@lo:400:kworker.0 Request processed in 62us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625249.038133:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788625249.038160:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206193664 00000100:00100000:2.0:1788625249.038164:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206193664 00000100:00100000:2.0:1788625249.038201:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206194176 00000100:00100000:2.0:1788625249.038220:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206194176 00000100:00100000:2.0:1788625249.038246:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788625249.038253:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206193664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625249.038284:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206193664:12345-0@lo:400:kworker.0 Request processed in 32us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625249.038290:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788625249.038302:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788625249.038307:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206194176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625249.038331:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206194176:12345-0@lo:400:kworker.0 Request processed in 24us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625249.038337:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788625249.038402:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206193152:0@lo:400:kworker.0 00010000:00080000:2.0:1788625249.038419:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742ea2d80 x1875509206193664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625249.038431:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206193664:0@lo:400:kworker.0 00000100:00100000:1.0:1788625249.038443:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788625249.038446:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439f2680 x1875509206194176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625249.038455:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206194176:0@lo:400:kworker.0 00000100:00100000:1.0:1788625249.038486:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206193536:0@lo:400:kworker.0 00000100:00100000:1.0:1788625249.038538:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625249.038563:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206194048:0@lo:400:kworker.0 00000100:00100000:1.0:1788625249.038583:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625249.038745:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625249.038778:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206193408:0@lo:400:kworker.0 00000100:00100000:0.0:1788625249.038806:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625249.038826:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206193920:0@lo:400:kworker.0 00000100:00100000:0.0:1788625249.038851:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625249.038868:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206194432:0@lo:400:kworker.0 00000100:00100000:0.0:1788625249.038889:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625249.038923:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206192896 00000100:00100000:0.0:1788625249.038927:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206192896 00000100:00100000:0.0:1788625249.038956:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788625249.038962:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206192896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625249.038995:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206192896:12345-0@lo:400:kworker.0 Request processed in 33us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625249.039001:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788625249.039028:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206193920 00000100:00100000:0.0:1788625249.039031:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206193920 00000100:00100000:0.0:1788625249.039052:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206194432 00000100:00100000:0.0:1788625249.039055:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206194432 00000100:00100000:0.0:1788625249.039078:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788625249.039085:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3636:x1875509206193920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625249.039126:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3636:x1875509206193920:12345-0@lo:400:kworker.0 Request processed in 41us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625249.039132:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788625249.039143:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788625249.039149:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875509206194432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625249.039175:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875509206194432:12345-0@lo:400:kworker.0 Request processed in 27us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625249.039180:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788625249.039201:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206193408 00000100:00100000:0.0:1788625249.039204:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206193408 00000100:00100000:0.0:1788625249.039219:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788625249.039224:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206193408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625249.039252:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206193408:12345-0@lo:400:kworker.0 Request processed in 27us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625249.039257:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788625249.039282:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206192896:0@lo:400:kworker.0 00000100:00100000:0.0:1788625249.039291:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206193408:0@lo:400:kworker.0 00000100:00100000:0.0:1788625249.039300:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206193920:0@lo:400:kworker.0 00000100:00100000:0.0:1788625249.039309:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206194432:0@lo:400:kworker.0 00000100:00100000:2.0:1788625249.039804:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206193024 00000100:00100000:2.0:1788625249.039809:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206193024 00000100:00100000:2.0:1788625249.039831:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206193536 00000100:00100000:2.0:1788625249.039834:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206193536 00000100:00100000:2.0:1788625249.039848:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788625249.039854:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206193024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625249.039924:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206193024:12345-0@lo:400:kworker.0 Request processed in 70us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625249.039937:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788625249.039950:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788625249.039955:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206193536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625249.039979:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206193536:12345-0@lo:400:kworker.0 Request processed in 24us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625249.039985:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:2.0:1788625249.040001:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788625249.040005:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625249.040007:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788625249.040423:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206193024:0@lo:400:kworker.0 00000100:00100000:1.0:1788625249.040435:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206193536:0@lo:400:kworker.0 00000100:00100000:0.0:1788625249.040464:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206194048 00000100:00100000:0.0:1788625249.040480:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206194048 00000100:00080000:1.0:1788625249.042402:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625249.042507:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625249.045498:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206193792:0@lo:400:kworker.0 00000100:00100000:3.0:1788625249.045584:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625249.045606:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206194304:0@lo:400:kworker.0 00000100:00100000:3.0:1788625249.045627:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625249.045952:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206193280 00000100:00100000:2.0:1788625249.045961:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206193280 00000100:00100000:2.0:1788625249.046016:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788625249.046026:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206194048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625249.046089:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206194048:12345-0@lo:400:kworker.0 Request processed in 65us (7504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625249.046096:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788625249.046114:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788625249.046120:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206193280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625249.046150:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206193280:12345-0@lo:400:kworker.0 Request processed in 31us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625249.046156:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788625249.046215:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206193280:0@lo:400:kworker.0 00000100:00100000:2.0:1788625249.046250:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206193792 00000100:00100000:2.0:1788625249.046255:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206193792 00000100:00100000:2.0:1788625249.046279:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206194304 00000100:00100000:2.0:1788625249.046283:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206194304 00000100:00100000:2.0:1788625249.046329:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788625249.046335:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206193792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625249.046373:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206193792:12345-0@lo:400:kworker.0 Request processed in 38us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625249.046379:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788625249.046391:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788625249.046396:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206194304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625249.046424:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206194304:12345-0@lo:400:kworker.0 Request processed in 28us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625249.046431:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788625249.046460:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206193792:0@lo:400:kworker.0 00000100:00100000:2.0:1788625249.046470:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206194304:0@lo:400:kworker.0 00000100:00080000:2.0:1788625249.046509:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625249.046545:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206194048:0@lo:400:kworker.0 00010000:00010000:3.0:1788625249.355695:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625249.547821:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206194688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625249.547899:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625249.547968:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625249.547975:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206194560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625249.548002:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625249.548033:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206194560 00000100:00100000:2.0:1788625249.548042:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206194560 00000100:00100000:2.0:1788625249.548089:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788625249.548097:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206194560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788625249.548134:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788625249.548177:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206194560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625249.548194:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788625249.548241:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206194560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625249.548329:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206194688 00000100:00100000:1.0:1788625249.548334:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206194688 00000100:00100000:1.0:1788625249.548412:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788625249.548420:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206194688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788625249.548440:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788625249.548505:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206194688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625249.548513:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788625249.548610:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206194688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625249.549875:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206194816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625249.549926:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625249.554765:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206194816 00000100:00100000:3.0:1788625249.554781:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206194816 00000100:00100000:3.0:1788625249.554833:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788625249.554842:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206194816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788625249.554869:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788625249.554953:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206194816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (5026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625249.554960:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788625249.555030:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206194816:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788625250.068881:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1788625250.068899:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:3.0:1788625250.381744:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625251.019751:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788625251.019761:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788625251.019781:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788625251.019790:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788625251.089944:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1788625251.090145:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1788625251.090774:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1788625251.090807:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99884537d780 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788625251.090812:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998866faea00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99884537d540 00000020:00080000:3.0:1788625251.090828:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998866fae600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff998743a98600 00000020:00080000:2.0:1788625251.090887:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:2.0:1788625251.090970:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1788625251.091284:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ac35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625251.091297:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ac35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625251.091306:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ac35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625251.091312:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625251.091317:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ac35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625251.091334:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ac35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625251.091355:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9988625be700) 00010000:00010000:1.0:1788625251.091358:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625251.091364:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ac35 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625251.091371:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ac35 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788625251.091670:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:1.0:1788625251.333879:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625251.333952:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625251.333992:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625251.334027:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625251.334047:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625251.334066:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625251.334100:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625251.334132:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185155072 00000100:00100000:1.0:1788625251.334142:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185155072 00000100:00100000:1.0:1788625251.334206:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 383 00000100:00100000:1.0:1788625251.334217:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185155072:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625251.334302:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185155072:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 86us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625251.334310:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 383 00000100:00100000:1.0:1788625251.334342:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185155200 00000100:00100000:1.0:1788625251.334346:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185155200 00000100:00100000:1.0:1788625251.334382:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185155712 00000100:00100000:1.0:1788625251.334391:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185155712 00000100:00100000:1.0:1788625251.334407:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185155328 00000100:00100000:1.0:1788625251.334410:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185155328 00000100:00100000:1.0:1788625251.334421:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 293 00000100:00100000:1.0:1788625251.334439:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+13:2393:x1875509185155200:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625251.334471:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+13:2393:x1875509185155200:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 44us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625251.334477:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 293 00000100:00100000:1.0:1788625251.334486:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185155840 00000100:00100000:1.0:1788625251.334489:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185155840 00000100:00100000:1.0:1788625251.334548:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 294 00000100:00100000:1.0:1788625251.334556:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185155712:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625251.334573:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185155456 00000100:00100000:0.0:1788625251.334578:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185155456 00000100:00100000:1.0:1788625251.334579:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185155712:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 26us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625251.334585:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 294 00000100:00100000:1.0:1788625251.334597:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 295 00000100:00100000:1.0:1788625251.334603:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185155328:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625251.334611:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185155584 00000100:00100000:0.0:1788625251.334614:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185155584 00000100:00100000:1.0:1788625251.334626:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185155328:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 24us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625251.334632:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 295 00000100:00100000:0.0:1788625251.334635:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 114 00000100:00100000:1.0:1788625251.334641:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 296 00000100:00100000:0.0:1788625251.334641:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185155456:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625251.334646:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185155840:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625251.334665:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185155840:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 20us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625251.334665:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185155456:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 25us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625251.334672:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 296 00000100:00100000:0.0:1788625251.334672:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 114 00000100:00100000:0.0:1788625251.334684:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 115 00000100:00100000:0.0:1788625251.334690:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185155584:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625251.334711:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185155584:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 21us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625251.334716:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 115 00000100:00080000:0.0:1788625251.334751:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625251.334755:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625251.334758:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788625251.334760:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788625251.404026:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625251.532337:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788625252.047665:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625252.049254:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185155968 00000100:00100000:1.0:1788625252.049269:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185155968 00000100:00100000:1.0:1788625252.049345:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 147 00000100:00100000:1.0:1788625252.049355:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+13:11084:x1875509185155968:12345-192.168.204.14@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788625252.050738:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+13:11084:x1875509185155968:12345-192.168.204.14@tcp:60:lhsmtool_posix.0 Request processed in 1378us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625252.050749:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 147 00000100:00100000:1.0:1788625252.058367:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625252.058642:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185156096 00000100:00100000:2.0:1788625252.058658:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185156096 00000100:00100000:2.0:1788625252.058785:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 148 00000100:00100000:2.0:1788625252.058799:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:11084:x1875509185156096:12345-192.168.204.14@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788625252.062742:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:11084:x1875509185156096:12345-192.168.204.14@tcp:60:lhsmtool_posix.0 Request processed in 3934us (4379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625252.062757:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 148 00000100:00100000:0.0:1788625252.070061:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625252.070590:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185156352 00000100:00100000:2.0:1788625252.070604:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185156352 00000100:00100000:2.0:1788625252.071246:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 35 00000100:00100000:2.0:1788625252.071263:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+13:11084:x1875509185156352:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788625252.072434:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:11084:x1875509185156352:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 1169us (2380us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788625252.072447:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 35 00000100:00100000:3.0:1788625252.301933:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625252.302078:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185156480 00000100:00100000:0.0:1788625252.302093:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185156480 00000100:00100000:0.0:1788625252.302220:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 149 00000100:00100000:0.0:1788625252.302234:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:11897:x1875509185156480:12345-192.168.204.14@tcp:101:lsof.0 00010000:00010000:0.0:1788625252.302265:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625252.304156:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7acc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e25f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625252.304245:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7acc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625252.304275:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7acc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625252.304290:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7acc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625252.304338:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788625252.304342:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625252.304503:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7acc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625252.304555:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7acc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e25f expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625252.304578:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7acc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e25f expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625252.304587:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:0.0:1788625252.304589:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625252.304593:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995c00, rc 0) 00000100:00100000:0.0:1788625252.304671:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:11897:x1875509185156480:12345-192.168.204.14@tcp:101:lsof.0 Request processed in 2440us (2753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625252.304681:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 149 00010000:00010000:3.0:1788625252.427746:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625253.131939:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625253.131983:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206194944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788625253.132088:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625253.132357:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206194944 00000100:00100000:2.0:1788625253.132366:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206194944 00000100:00100000:2.0:1788625253.132453:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788625253.132465:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206194944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788625253.132538:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788625253.132629:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206194944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 166us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625253.132637:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788625253.132733:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206194944:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788625253.451758:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625253.644625:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788625253.644650:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206195200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625253.644744:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625253.644813:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206195072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625253.644836:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625253.644976:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206195200 00000100:00100000:1.0:1788625253.644984:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206195200 00000100:00100000:1.0:1788625253.645088:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206195072 00000100:00100000:1.0:1788625253.645092:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206195072 00000100:00100000:3.0:1788625253.645567:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788625253.645582:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206195200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788625253.645625:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625253.645692:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206195200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625253.645700:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788625253.646019:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206195200:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788625253.646499:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625253.646665:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788625253.646674:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206195072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625253.646692:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625253.646749:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206195072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625253.646755:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788625253.646925:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788625253.646932:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1788625253.646950:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9987441b8a80, transno 4294967305 00000100:00100000:0.0:1788625253.646971:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206195072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625254.156231:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625254.156256:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206195712:0@lo:400:kworker.0 00000100:00100000:0.0:1788625254.156304:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206195584:0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.156340:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625254.156347:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625254.156412:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206196096:0@lo:400:kworker.0 00000100:00100000:1.0:1788625254.156417:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206195456:0@lo:400:kworker.0 00000100:00100000:2.0:1788625254.156469:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206195584 00000100:00100000:2.0:1788625254.156478:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206195584 00000100:00100000:2.0:1788625254.156565:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788625254.156576:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206195584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.159325:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206195328:0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.159910:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625254.160671:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206196224:0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.160728:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625254.161117:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206196736:0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.161143:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625254.161165:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788625254.161172:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206195840:0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.161223:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625254.161238:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206196352:0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.161258:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625254.161286:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206196864:0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.161305:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625254.161352:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206195328 00000100:00100000:3.0:1788625254.161361:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206195328 00000100:00100000:3.0:1788625254.161424:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788625254.161434:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3637:x1875509206195328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.161491:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3637:x1875509206195328:12345-0@lo:400:kworker.0 Request processed in 59us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625254.161498:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788625254.161574:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206196224 00000100:00100000:3.0:1788625254.161578:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206196224 00000100:00100000:3.0:1788625254.161600:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206196736 00000100:00100000:3.0:1788625254.161602:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206196736 00000100:00100000:3.0:1788625254.161626:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206196352 00000100:00100000:3.0:1788625254.161629:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206196352 00000100:00100000:3.0:1788625254.161639:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206196864 00000100:00100000:3.0:1788625254.161641:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206196864 00000100:00100000:3.0:1788625254.161654:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788625254.161660:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206196224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.161693:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206196224:12345-0@lo:400:kworker.0 Request processed in 34us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625254.161698:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788625254.161709:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788625254.161714:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206196736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.161768:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206196736:12345-0@lo:400:kworker.0 Request processed in 39us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625254.161774:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788625254.161785:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788625254.161791:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206196352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.161822:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206196352:12345-0@lo:400:kworker.0 Request processed in 27us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625254.161828:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788625254.161837:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788625254.161843:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206196864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.161867:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206196864:12345-0@lo:400:kworker.0 Request processed in 25us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625254.161878:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788625254.161905:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788625254.161914:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788625254.162049:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206196352:0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.162059:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1788625254.162065:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1788625254.162089:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206196864:0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.162098:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206196224:0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.162107:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206196736:0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.162116:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206195328:0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.162236:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206195840 00000100:00100000:3.0:1788625254.162241:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206195840 00000100:00100000:3.0:1788625254.162339:0:14517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788625254.162346:0:14517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206195840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.162400:0:14517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206195840:12345-0@lo:400:kworker.0 Request processed in 54us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625254.162406:0:14517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788625254.162429:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206195840:0@lo:400:kworker.0 00000100:00080000:3.0:1788625254.162484:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625254.162509:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206195712 00000100:00100000:3.0:1788625254.162512:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206195712 00000100:00100000:3.0:1788625254.162565:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788625254.162570:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206195712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.162603:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206195712:12345-0@lo:400:kworker.0 Request processed in 33us (6264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625254.162609:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788625254.162633:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206195712:0@lo:400:kworker.0 00000100:00100000:0.0:1788625254.163925:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625254.164048:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206196608:0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.164054:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206196096 00000100:00100000:3.0:1788625254.164061:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206196096 00000100:00100000:0.0:1788625254.164089:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625254.164137:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625254.166055:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206195584:12345-0@lo:400:kworker.0 Request processed in 9473us (9698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625254.166069:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1788625254.166208:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625254.171252:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206196608 00000100:00100000:0.0:1788625254.171279:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206196608 00000100:00100000:0.0:1788625254.171565:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206195456 00000100:00100000:0.0:1788625254.171570:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206195456 00000100:00100000:0.0:1788625254.171592:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788625254.171602:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206196096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625254.171702:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206196096:12345-0@lo:400:kworker.0 Request processed in 101us (7782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625254.171711:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788625254.171730:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788625254.171737:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206196608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625254.171767:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206196608:12345-0@lo:400:kworker.0 Request processed in 31us (7677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625254.171773:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788625254.171785:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788625254.171791:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206195456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625254.171819:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206195456:12345-0@lo:400:kworker.0 Request processed in 28us (7682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625254.171824:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788625254.172419:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206195584:0@lo:400:kworker.0 00010000:00080000:0.0:1788625254.172438:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99874427ed80 x1875509206196096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625254.172449:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206196096:0@lo:400:kworker.0 00010000:00080000:0.0:1788625254.172462:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99874427f100 x1875509206196608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625254.172470:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206196608:0@lo:400:kworker.0 00000100:00100000:0.0:1788625254.172554:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206195456:0@lo:400:kworker.0 00000100:00100000:0.0:1788625254.172566:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206195968:0@lo:400:kworker.0 00000100:00100000:0.0:1788625254.172605:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625254.172633:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206195968 00000100:00100000:0.0:1788625254.172637:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206195968 00000100:00100000:0.0:1788625254.172670:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788625254.172677:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206195968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625254.172709:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206195968:12345-0@lo:400:kworker.0 Request processed in 33us (103us total) trans 0 rc 0/0 00000100:00080000:3.0:1788625254.172716:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625254.172716:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:3.0:1788625254.172720:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625254.172739:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206195968:0@lo:400:kworker.0 00000100:00100000:0.0:1788625254.172746:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206196480:0@lo:400:kworker.0 00000100:00100000:0.0:1788625254.172768:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625254.173016:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206196480 00000100:00100000:3.0:1788625254.173021:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206196480 00000100:00100000:3.0:1788625254.173063:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788625254.173069:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206196480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625254.173110:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206196480:12345-0@lo:400:kworker.0 Request processed in 42us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625254.173116:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:0.0:1788625254.173140:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625254.173159:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206196480:0@lo:400:kworker.0 00010000:00010000:2.0:1788625254.476010:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625254.667663:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99887f8a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206197120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625254.667736:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625254.667789:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206197248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625254.667794:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206197120 00000100:00100000:2.0:1788625254.667802:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206197120 00000100:00100000:3.0:1788625254.667854:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625254.667869:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788625254.667880:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206197120:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625254.667890:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206197248 00000100:00100000:3.0:1788625254.667896:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206197248 00000004:00000024:2.0:1788625254.667927:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788625254.667934:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788625254.667945:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206197248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788625254.667971:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788625254.667978:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206197120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625254.667987:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788625254.668013:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206197248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625254.668021:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788625254.668058:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99887f8a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206197120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625254.668068:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206196992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625254.668074:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206197248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625254.668106:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625254.668468:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206196992 00000100:00100000:3.0:1788625254.668473:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206196992 00000100:00100000:3.0:1788625254.668507:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788625254.668542:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206196992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788625254.668557:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788625254.668601:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206196992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625254.668608:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788625254.668641:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206196992:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1788625255.356556:0:14554:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:20:52 (1788625252) 00010000:00010000:3.0:1788625255.499726:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625256.457870:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625256.457920:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625256.457958:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625256.457991:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625256.457996:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185156864 00000100:00100000:2.0:1788625256.458008:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185156864 00000100:00100000:3.0:1788625256.458031:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185157120 00000100:00100000:1.0:1788625256.458036:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625256.458037:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185157120 00000100:00100000:1.0:1788625256.458058:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625256.458080:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185157376 00000100:00100000:2.0:1788625256.458084:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185157376 00000100:00100000:2.0:1788625256.458110:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185156736 00000100:00100000:2.0:1788625256.458113:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185156736 00000100:00100000:0.0:1788625256.458122:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185156608 00000100:00100000:2.0:1788625256.458134:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 303 00000100:00100000:0.0:1788625256.458134:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185156608 00000100:00100000:2.0:1788625256.458149:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185156864:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625256.458156:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185156992 00000100:00100000:3.0:1788625256.458161:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185156992 00000100:00100000:0.0:1788625256.458183:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 385 00000100:00100000:3.0:1788625256.458187:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 120 00000100:00100000:0.0:1788625256.458191:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185156608:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625256.458193:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185157120:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625256.458232:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185156864:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 86us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625256.458242:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 303 00000100:00100000:0.0:1788625256.458259:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185156608:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 67us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625256.458267:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 385 00000100:00100000:2.0:1788625256.458276:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 304 00000100:00100000:2.0:1788625256.458286:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185157376:12345-192.168.204.14@tcp:400:kworker.0 00000100:00080000:0.0:1788625256.458301:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625256.458307:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788625256.458309:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625256.458311:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625256.458333:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 305 00000100:00100000:0.0:1788625256.458341:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:2393:x1875509185156736:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625256.464123:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185157120:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 5917us (6151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625256.464136:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625256.464192:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 120 00000100:00100000:3.0:1788625256.464254:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 121 00000100:00100000:3.0:1788625256.464266:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185156992:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625256.464361:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185156992:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 98us (6301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625256.464368:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 121 00000100:00100000:3.0:1788625256.464452:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185157248 00000100:00100000:2.0:1788625256.466311:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185157376:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 8013us (8306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625256.466311:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:2393:x1875509185156736:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 7957us (8260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625256.466853:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185157248 00000100:00100000:2.0:1788625256.467640:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 304 00000100:00080000:2.0:1788625256.467693:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625256.471831:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 305 00000100:00100000:3.0:1788625256.471882:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 306 00000100:00100000:3.0:1788625256.471972:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2393:x1875509185157248:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625256.472075:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2393:x1875509185157248:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 116us (7939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625256.473263:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 306 00010000:00010000:3.0:1788625256.523696:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625256.609626:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625256.609716:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185157632 00000100:00100000:3.0:1788625256.609742:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185157632 00000100:00100000:3.0:1788625256.609801:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 150 00000100:00100000:3.0:1788625256.609810:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:12165:x1875509185157632:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625256.609830:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625256.609853:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7accf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e266 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.609928:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7acd6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.609961:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7acd6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.609972:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7acd6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610039:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7acdd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610048:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7acdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610055:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7acdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610446:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7ace4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610456:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7ace4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610463:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7ace4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625256.610474:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788625256.610594:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7acd6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610603:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7acd6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610609:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7acd6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610623:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625256.610628:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7acd6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610637:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7acd6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610649:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9988749c3d00) 00010000:00010000:3.0:1788625256.610652:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625256.610656:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7acd6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610662:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7acd6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610676:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7acdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610682:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7acdd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610687:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7acdd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610691:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625256.610694:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7acdd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610699:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7acdd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610717:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9988606b3300) 00010000:00010000:3.0:1788625256.610719:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625256.610722:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7acdd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610728:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7acdd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.610995:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7accf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e266 expref: 17 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.611009:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7ace4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e266 expref: 16 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625256.611016:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998743548200) 00010000:00010000:3.0:1788625256.611019:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625256.611021:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683600, rc 0) 00000100:00100000:3.0:1788625256.611089:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:12165:x1875509185157632:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 1279us (1472us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788625256.611097:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 150 00000100:00100000:2.0:1788625256.615662:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625256.615828:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185157760 00000100:00100000:0.0:1788625256.615839:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185157760 00000100:00100000:0.0:1788625256.615899:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 151 00000100:00100000:0.0:1788625256.615910:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:12165:x1875509185157760:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788625256.616226:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:12165:x1875509185157760:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 Request processed in 315us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625256.616234:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 151 00000001:00080000:0.0:1788625256.617655:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:0.0:1788625256.617679:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788625256.617801:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788625256.617823:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788625256.623837:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625256.624398:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185157888 00000100:00100000:0.0:1788625256.624416:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185157888 00000100:00100000:0.0:1788625256.624551:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:0.0:1788625256.624563:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:2391:x1875509185157888:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625256.624579:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625256.624604:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7ace4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e266 expref: 14 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625256.624626:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998743548200) 00010000:00010000:0.0:1788625256.624632:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625256.624693:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+13:2391:x1875509185157888:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 133us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625256.624701:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:3.0:1788625256.629963:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625256.630046:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185158016 00000100:00100000:2.0:1788625256.630057:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185158016 00000100:00100000:2.0:1788625256.630128:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 152 00000100:00100000:2.0:1788625256.630138:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:12165:x1875509185158016:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788625256.630253:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:12165:x1875509185158016:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 Request processed in 116us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625256.630262:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 152 00000040:00080000:3.0:1788625256.652465:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788625257.165099:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788625257.165109:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625257.165643:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788625257.165654:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788625257.549436:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625258.253811:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206197376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625258.253926:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625258.254365:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206197376 00000100:00100000:0.0:1788625258.254375:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206197376 00000100:00100000:0.0:1788625258.254437:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788625258.254448:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206197376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625258.254495:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788625258.256428:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206197376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1973us (2493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625258.256442:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788625258.259973:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206197376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625258.311325:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625258.311407:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185158144 00000100:00100000:2.0:1788625258.311422:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185158144 00000100:00100000:2.0:1788625258.311513:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 153 00000100:00100000:2.0:1788625258.311545:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+13:12207:x1875509185158144:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625258.311572:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625258.311607:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7acf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e26d expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311696:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7acf9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311715:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7acf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311739:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7acf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311757:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7ad00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311764:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7ad00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311771:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7ad00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311836:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7acf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311846:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7acf9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311853:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7acf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788625258.311858:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788625258.311860:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625258.311865:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7acf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311874:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7acf9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311889:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:2.0:1788625258.311892:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625258.311898:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7acf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311911:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7acf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311923:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7ad00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311930:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7ad00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311936:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7ad00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311941:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625258.311945:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7ad00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311950:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7ad00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311959:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9988625be200) 00010000:00010000:2.0:1788625258.311962:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625258.311965:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7ad00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.311971:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7ad00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.312016:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7acf2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e26d expref: 14 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.312040:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:2.0:1788625258.312043:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625258.312048:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7acf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e26d expref: 14 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.312059:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744189e00, rc 0) 00000100:00100000:2.0:1788625258.312148:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+13:12207:x1875509185158144:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 607us (838us total) trans 0 rc 301/301 00000100:00100000:2.0:1788625258.312157:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 153 00000100:00100000:2.0:1788625258.324279:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625258.324406:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185158400 00000100:00100000:0.0:1788625258.324420:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185158400 00000100:00100000:0.0:1788625258.324495:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 154 00000100:00100000:0.0:1788625258.324506:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+13:12207:x1875509185158400:12345-192.168.204.14@tcp:36:lfs.0 00010000:00010000:0.0:1788625258.327862:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625258.327918:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7a646 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e091 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.327958:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:0.0:1788625258.327966:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625258.329259:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad07 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.329294:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7acc8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e25f expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.329305:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad07 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.329352:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7acc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e25f expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.329372:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7acc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e25f expref: 5 pid: 6512 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625258.329390:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875509206197504:192.168.204.14@tcp:104: 00000100:00100000:0.0:1788625258.329601:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987435509c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625258.341382:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625258.341481:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875509206197504:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625258.341535:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad07 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625258.341606:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185158528 00000100:00100000:3.0:1788625258.341615:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185158528 00010000:00010000:3.0:1788625258.341679:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7acc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e25f expref: 6 pid: 6512 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788625258.341769:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625258.341817:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 81 00000100:00100000:3.0:1788625258.341828:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2393:x1875509185158528:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625258.341845:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625258.341854:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7acc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e25f expref: 6 pid: 6512 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.341867:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7acc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e25f expref: 6 pid: 6512 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.341895:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7acc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e25f expref: 6 pid: 6512 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.341912:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:3.0:1788625258.341918:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad07 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.341929:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.341938:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad07 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.341969:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625258.342048:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185158528:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 220us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625258.342056:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 81 00010000:00010000:0.0:1788625258.342110:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.342118:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.342149:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7ad0e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.342170:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7ad0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.342178:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7ad0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.342855:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7ad15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.342866:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7ad15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.342874:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7ad15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625258.342892:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed3947f9 reply state 00000000931876ab transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7ad15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.342905:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7ad15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.342913:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:0.0:1788625258.342916:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788625258.342919:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788625258.342927:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788625258.342937:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.342943:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad07 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.342951:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad07 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.342963:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625258.342969:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad07 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.342977:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad07 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.342988:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:0.0:1788625258.342991:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625258.342995:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad07 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.343001:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad07 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625258.343021:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed3947f9 reply state 00000000931876ab transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7ad0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.343029:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7ad0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.343035:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9988749c9a00) 00010000:00010000:0.0:1788625258.343038:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788625258.343040:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788625258.343118:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:12207:x1875509185158400:12345-192.168.204.14@tcp:36:lfs.0 Request processed in 18611us (18852us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788625258.343127:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 154 00000100:00100000:1.0:1788625258.450650:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625258.450776:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185158656 00000100:00100000:0.0:1788625258.450790:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185158656 00000100:00100000:0.0:1788625258.450917:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 155 00000100:00100000:0.0:1788625258.450951:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:12215:x1875509185158656:12345-192.168.204.14@tcp:101:lctl.0 00010000:00010000:0.0:1788625258.450986:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625258.451019:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e274 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.451129:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ad23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.451148:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ad23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.451163:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ad23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625258.451223:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788625258.451228:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625258.451252:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ad23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.451295:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e274 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.451314:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ad23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e274 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.451326:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:0.0:1788625258.451329:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625258.451334:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995c00, rc 0) 00000100:00100000:0.0:1788625258.451473:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+15:12215:x1875509185158656:12345-192.168.204.14@tcp:101:lctl.0 Request processed in 524us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625258.451491:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 155 00000100:00100000:3.0:1788625258.511689:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625258.521350:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185158784 00000100:00100000:1.0:1788625258.521367:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185158784 00000100:00100000:1.0:1788625258.522824:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 156 00000100:00100000:1.0:1788625258.523184:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+15:12221:x1875509185158784:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:1.0:1788625258.523212:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625258.523238:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7ad2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e27b expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.523320:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7ad31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.523336:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7ad31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.523348:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7ad31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.523360:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ad38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.523384:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ad38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.523391:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ad38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.524777:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ad3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.524796:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ad3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.524806:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ad3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625258.525024:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788625258.525029:0:9824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625258.525053:0:9824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ad3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525067:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7ad31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525074:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7ad31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525081:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7ad31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525088:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625258.525093:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7ad31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525174:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7ad31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525189:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:1.0:1788625258.525191:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625258.525197:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7ad31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525203:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7ad31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525218:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ad38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525224:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ad38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525230:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ad38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525235:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625258.525237:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ad38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525243:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ad38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525250:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9988749c9a00) 00010000:00010000:1.0:1788625258.525253:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625258.525256:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ad38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525271:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ad38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525316:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7ad2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e27b expref: 17 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525330:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ad3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e27b expref: 16 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.525338:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:1.0:1788625258.525341:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788625258.525344:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5c00, rc 0) 00000100:00100000:1.0:1788625258.525440:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:12221:x1875509185158784:12345-192.168.204.14@tcp:101:bash.0 Request processed in 2602us (13760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625258.526956:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 156 00000100:00100000:3.0:1788625258.532967:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625258.533269:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185159040 00000100:00100000:0.0:1788625258.533291:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185159040 00000100:00100000:0.0:1788625258.533353:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 157 00000100:00100000:0.0:1788625258.533363:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+16:12221:x1875509185159040:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:0.0:1788625258.533384:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625258.533405:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad46 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e282 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.533565:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ad4d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.533583:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ad4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.533596:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ad4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.533655:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7ad54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.533664:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7ad54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.533672:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7ad54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788625258.534017:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788625258.534160:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7ad5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.534185:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7ad5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.534194:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7ad5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.534228:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ad4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.534235:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ad4d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.534241:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ad4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.534247:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625258.534251:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ad4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.534259:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ad4d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.534271:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:0.0:1788625258.534275:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625258.534291:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ad4d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.534298:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ad4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625258.534314:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a47b576d reply state 00000000d6978c02 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7ad54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.534332:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7ad54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.534339:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988749c9300) 00010000:00010000:0.0:1788625258.534341:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788625258.534344:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788625258.534374:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad46 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e282 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.534389:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7ad5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e282 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.534396:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c9600) 00010000:00010000:0.0:1788625258.534398:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625258.534401:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882170c00, rc 0) 00000100:00100000:0.0:1788625258.534474:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:12221:x1875509185159040:12345-192.168.204.14@tcp:101:bash.0 Request processed in 1113us (1517us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1788625258.534482:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 157 00000100:00100000:2.0:1788625258.542420:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625258.543001:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185159168 00000100:00100000:3.0:1788625258.543014:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185159168 00000100:00100000:3.0:1788625258.543146:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 55 00000100:00100000:3.0:1788625258.543159:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185159168:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:3.0:1788625258.543181:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625258.543207:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7ad69 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e289 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788625258.543238:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625258.543259:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1788625258.543264:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625258.543274:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7ad69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e289 expref: 6 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.543309:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7ad69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e289 expref: 6 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.543326:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683c00, rc 0) 00000100:00100000:3.0:1788625258.543397:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185159168:12345-192.168.204.14@tcp:101:bash.0 Request processed in 241us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625258.543404:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 55 00000100:00080000:0.0:1788625258.544043:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625258.549472:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625258.549646:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185159296 00000100:00100000:1.0:1788625258.549657:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185159296 00000100:00100000:1.0:1788625258.549725:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00100000:1.0:1788625258.549738:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:12221:x1875509185159296:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:1.0:1788625258.549758:0:8868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625258.549780:0:8868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e290 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.549815:0:8868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7ad69 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e289 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.549846:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625258.549851:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625258.549858:0:8868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 7 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.550022:0:8868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7ad69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e289 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.550036:0:8868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7ad69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e289 expref: 7 pid: 8424 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625258.550051:0:8868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8868:1875509206197632:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625258.550225:0:8868:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c4d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625258.566064:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625258.566143:0:8868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8868:1875509206197632:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625258.566181:0:8868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 7 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.566205:0:8868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4c00, rc 0) 00000100:00100000:1.0:1788625258.566307:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:12221:x1875509185159296:12345-192.168.204.14@tcp:101:bash.0 Request processed in 16571us (16845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625258.566317:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00100000:0.0:1788625258.566479:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185159424 00000100:00100000:0.0:1788625258.566488:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185159424 00010000:00010000:0.0:1788625258.566579:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7ad69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e289 expref: 7 pid: 8424 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625258.566624:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 82 00000100:00100000:0.0:1788625258.566638:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185159424:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625258.566652:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625258.566688:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7ad69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e289 expref: 7 pid: 8424 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.566703:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7ad69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e289 expref: 7 pid: 8424 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.566726:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7ad69 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e289 expref: 7 pid: 8424 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.566741:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625258.566745:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625258.566753:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 6 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.566762:0:9513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 6 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.566798:0:9513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 6 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625258.566815:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9513:1875509206197760:192.168.204.14@tcp:105: 00000100:00100000:0.0:1788625258.566902:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743550000 going to sleep for 11 seconds 00000100:00100000:0.0:1788625258.571631:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9513:1875509206197760:192.168.204.14@tcp:105: 00010000:00010000:0.0:1788625258.571665:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625258.571700:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625258.571730:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185159424:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 5094us (5680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625258.571767:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 82 00000100:00100000:2.0:1788625258.577078:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625258.577193:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185159680 00000100:00100000:1.0:1788625258.577205:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185159680 00000100:00100000:1.0:1788625258.577266:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 36 00000100:00100000:1.0:1788625258.577304:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:12221:x1875509185159680:12345-192.168.204.14@tcp:35:bash.0 00000100:00100000:1.0:1788625258.579145:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+20:12221:x1875509185159680:12345-192.168.204.14@tcp:35:bash.0 Request processed in 1834us (2067us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788625258.579157:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 36 00000100:00100000:3.0:1788625258.663319:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625258.663498:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185159936 00000100:00100000:0.0:1788625258.663513:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185159936 00000100:00100000:0.0:1788625258.663661:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 158 00000100:00100000:0.0:1788625258.663677:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+20:12231:x1875509185159936:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:0.0:1788625258.663716:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625258.663746:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ad77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e297 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625258.663894:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788625258.664068:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ad77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e297 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.664086:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:0.0:1788625258.664090:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788625258.664096:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ad77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e297 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.664116:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882171200, rc 0) 00000100:00100000:0.0:1788625258.664196:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:12231:x1875509185159936:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 524us (893us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1788625258.664205:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 158 00000100:00100000:2.0:1788625258.668398:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625258.669215:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185160192 00000100:00100000:0.0:1788625258.669231:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185160192 00000100:00100000:0.0:1788625258.669331:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 37 00000100:00100000:0.0:1788625258.669344:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:12231:x1875509185160192:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:0.0:1788625258.669746:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:12231:x1875509185160192:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 403us (1371us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788625258.669755:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 37 00000100:00100000:3.0:1788625258.764187:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206197888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625258.764448:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625258.764477:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206198016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625258.764505:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625258.764797:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625258.764903:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206197888 00000100:00100000:1.0:1788625258.764913:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206197888 00000100:00100000:1.0:1788625258.764988:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206198016 00000100:00100000:1.0:1788625258.764992:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206198016 00000100:00100000:1.0:1788625258.765014:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788625258.765025:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206197888:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788625258.765330:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625258.765354:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788625258.765366:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206198016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625258.765404:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625258.765876:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206198016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 511us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625258.765887:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00002000:00000024:1.0:1788625258.766314:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625258.766500:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206198016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788625258.766672:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206197888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1648us (2168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625258.766682:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788625258.767293:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206197888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625258.779873:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625258.781293:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185160320 00000100:00100000:2.0:1788625258.781311:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185160320 00000100:00100000:2.0:1788625258.781403:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 159 00000100:00100000:2.0:1788625258.781417:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:12237:x1875509185160320:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625258.781463:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625258.781493:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188600/0x2d2e3b3f34a7ad85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e29e expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.781622:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7ad8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.781665:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7ad8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.781693:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7ad8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625258.781957:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788625258.781963:0:9824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625258.781991:0:9824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7ad8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.782028:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188600/0x2d2e3b3f34a7ad85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e29e expref: 24 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.782052:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7ad8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e29e expref: 23 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.782062:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:2.0:1788625258.782065:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625258.782070:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188200, rc 0) 00000100:00100000:2.0:1788625258.782616:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+23:12237:x1875509185160320:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 1199us (2754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625258.782626:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 159 00000100:00100000:3.0:1788625258.787928:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625258.788145:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185160576 00000100:00100000:0.0:1788625258.788158:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185160576 00000100:00100000:0.0:1788625258.788237:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 160 00000100:00100000:0.0:1788625258.788248:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+23:12237:x1875509185160576:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:0.0:1788625258.788289:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625258.788319:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ad93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e2a5 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.789598:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.789624:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.789639:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625258.789654:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788625258.791176:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ad93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2a5 expref: 26 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.791214:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2a5 expref: 25 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.791227:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c9600) 00010000:00010000:0.0:1788625258.791230:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625258.791236:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887c995000, rc 0) 00000100:00100000:0.0:1788625258.791903:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+25:12237:x1875509185160576:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 3653us (3987us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1788625258.791915:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 160 00000100:00100000:3.0:1788625258.803926:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625258.805670:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625258.805956:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185160960 00000100:00100000:2.0:1788625258.805969:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185160960 00000100:00100000:2.0:1788625258.806061:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00100000:2.0:1788625258.806074:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+25:2393:x1875509185160960:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625258.806102:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625258.806149:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995000/0x2d2e3b3f34a7ad9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2a5 expref: 25 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.806175:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c9600) 00010000:00010000:2.0:1788625258.806181:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625258.806271:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:2393:x1875509185160960:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 199us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625258.806290:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00100000:0.0:1788625258.808000:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185160832 00000100:00100000:0.0:1788625258.808022:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185160832 00000100:00100000:0.0:1788625258.808293:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 161 00000100:00100000:0.0:1788625258.808306:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:12237:x1875509185160832:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:0.0:1788625258.808339:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625258.808381:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ada8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e2ac expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.808660:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7adaf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.808950:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7adaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.809177:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7adaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625258.809212:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788625258.809374:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882171200/0x2d2e3b3f34a7ada8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2ac expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.809399:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7adaf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2ac expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.809410:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c9600) 00010000:00010000:0.0:1788625258.809413:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788625258.809418:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae1600, rc 0) 00000100:00100000:0.0:1788625258.809880:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+26:12237:x1875509185160832:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 1575us (5966us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1788625258.809891:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 161 00000100:00100000:2.0:1788625258.833550:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625258.833712:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185161088 00000100:00100000:3.0:1788625258.833727:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185161088 00000100:00100000:3.0:1788625258.833898:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00100000:3.0:1788625258.833911:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2392:x1875509185161088:12345-192.168.204.14@tcp:1:lfs.0 00010000:00010000:3.0:1788625258.833983:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7adbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.834013:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 6 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.834023:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625258.834028:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625258.834178:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7adbd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.834228:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 6 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.834245:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 6 pid: 8868 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625258.834300:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8424:1875509206198144:192.168.204.14@tcp:104: 00000100:00100000:3.0:1788625258.834492:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988512d23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625258.849246:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8424:1875509206198144:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625258.849303:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7adbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625258.855134:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625258.855672:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185161216 00000100:00100000:1.0:1788625258.855684:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185161216 00002000:00100000:1.0:1788625258.855757:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff99874427e300 x1875509185161216/t0(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:69/0 lens 504/0 e 0 to 0 dl 1788625269 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625258.855770:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99874427e300 with x1875509185161216 ext(0->12) 00010000:00010000:1.0:1788625258.855780:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 7 pid: 8868 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.855798:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 7 pid: 8868 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625258.855836:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99874427e300 00000100:00100000:1.0:1788625258.856062:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 2 00000100:00100000:1.0:1788625258.856073:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2394:x1875509185161216:12345-192.168.204.14@tcp:4:lfs.0 00000100:00100000:1.0:1788625258.859774:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:2394:x1875509185161216:12345-192.168.204.14@tcp:4:lfs.0 Request processed in 3690us (4637us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788625258.859790:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 2 00002000:00100000:1.0:1788625258.859803:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff99874427e300 x1875509185161216/t4294967306(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:69/0 lens 504/448 e 0 to 0 dl 1788625269 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625258.859814:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99874427e300 with x1875509185161216 ext(0->12) 00010000:00010000:1.0:1788625258.859827:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 9 pid: 8868 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.860170:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 9 pid: 8868 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625258.860239:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99874427e300 00000100:00100000:2.0:1788625258.871775:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625258.873810:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185161344 00000100:00100000:3.0:1788625258.873831:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185161344 00010000:00010000:3.0:1788625258.873905:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 9 pid: 8868 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625258.873968:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 83 00000100:00100000:3.0:1788625258.873980:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858356300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:2391:x1875509185161344:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625258.874003:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788625258.874027:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788625258.874031:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788625257 00002000:00010000:3.0:1788625258.874033:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788625257 00002000:00010000:3.0:1788625258.874036:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788625257 00002000:00010000:3.0:1788625258.874039:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788625258.874044:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 9 pid: 8868 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.874062:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 9 pid: 8868 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.874119:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095527403/0x2d2e3b3f34a7ad70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e290 expref: 9 pid: 8868 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.874144:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625258.874149:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625258.874156:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7adbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.874168:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7adbd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.874211:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625258.874285:0:8424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7adbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.874299:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7adbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.874327:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7adbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.874344:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7adbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.874353:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7adbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.874361:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625258.874366:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7adbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.874385:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7adbd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.874399:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7adbd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625258.874407:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e56b8e9/0x2d2e3b3f34a7adbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625258.874644:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858356300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2391:x1875509185161344:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 664us (4317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625258.874654:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 83 00000100:00100000:2.0:1788625258.876850:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2392:x1875509185161088:12345-192.168.204.14@tcp:1:lfs.0 Request processed in 42924us (43328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625258.876867:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00100000:3.0:1788625258.882854:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625258.888094:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185161600 00000100:00100000:1.0:1788625258.888117:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185161600 00000100:00100000:1.0:1788625258.888213:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 38 00000100:00100000:1.0:1788625258.888226:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844c52450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+26:12237:x1875509185161600:12345-192.168.204.14@tcp:35:lfs.0 00000004:00010000:1.0:1788625258.888763:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7adaf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2ac expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625258.889045:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788625258.889083:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788625258.890102:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788625258.890164:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7adc4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.890187:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7ad5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e282 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.890198:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7adc4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.890250:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7ad5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e282 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.890269:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7ad5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e282 expref: 30 pid: 6513 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625258.890296:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744284e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6514:1875509206198272:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625258.893094:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff998849b12f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625258.895095:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744284e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6514:1875509206198272:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625258.895139:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7adc4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625258.896984:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625258.897150:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185161728 00000100:00100000:0.0:1788625258.897161:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185161728 00010000:00010000:0.0:1788625258.897211:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7ad5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e282 expref: 31 pid: 6513 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625258.897260:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 84 00000100:00100000:0.0:1788625258.897271:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+31:2391:x1875509185161728:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625258.897302:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625258.897310:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7ad5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e282 expref: 31 pid: 6513 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.897326:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7ad5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e282 expref: 31 pid: 6513 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.897391:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882170c00/0x2d2e3b3f34a7ad5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e282 expref: 31 pid: 6513 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.897416:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c9600) 00010000:00010000:0.0:1788625258.897422:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7adc4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.897433:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7adc4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.897443:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7adc4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625258.897481:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625258.897743:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7adc4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.897753:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7adc4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625258.897914:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1788625258.898061:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1788625258.898178:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744284e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875509206198400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788625258.898358:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+32:2391:x1875509185161728:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 1086us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625258.898368:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 84 00000100:00100000:1.0:1788625258.903851:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625258.903911:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c4d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625258.904036:0:14517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206198400 00000100:00100000:0.0:1788625258.904049:0:14517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206198400 00000100:00100000:0.0:1788625258.904127:0:14517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788625258.904139:0:14517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1875509206198400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788625258.904318:0:14517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1875509206198400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 181us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625258.904326:0:14517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788625258.904561:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744284e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875509206198400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788625258.904774:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1788625258.904872:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744278380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875509206198528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788625258.904919:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625258.904944:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988512d29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625258.905176:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206198528 00000100:00100000:1.0:1788625258.905182:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206198528 00000100:00100000:1.0:1788625258.905228:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788625258.905237:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1875509206198528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788625258.905395:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6514:x1875509206198528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 158us (475us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788625258.905402:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788625258.906303:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744278380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1875509206198528:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788625258.906398:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788625258.906479:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7adc4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.906493:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7adc4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.906504:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7adc4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.906511:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625258.906933:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7adc4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.906947:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7adc4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.906968:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c9600) 00010000:00010000:3.0:1788625258.906972:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788625258.906978:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7adc4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625258.906986:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7adc4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788625258.907136:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788625258.907218:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788625258.907232:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380014713938ns, next at 381014711265ns, rc = 0 00000001:00080000:3.0:1788625258.907239:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1788625258.907269:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c9600) 00010000:00010000:3.0:1788625258.907284:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788625258.907294:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7adaf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2ac expref: 34 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625258.907838:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844c52450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+33:12237:x1875509185161600:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 19611us (24998us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788625258.907851:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 38 00000020:00080000:3.0:1788625258.907858:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788625258.922344:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625258.922480:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185161856 00000100:00100000:1.0:1788625258.922494:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185161856 00000100:00100000:1.0:1788625258.922842:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 162 00000100:00100000:1.0:1788625258.922858:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+33:12237:x1875509185161856:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625258.922894:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625258.922928:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7adcb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e2b3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.923008:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7adcb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2b3 expref: 34 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.923026:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7adcb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2b3 expref: 34 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625258.923071:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625258.923075:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625258.923080:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5000, rc 0) 00000100:00100000:1.0:1788625258.923170:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+34:12237:x1875509185161856:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 317us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625258.923178:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 162 00000100:00100000:2.0:1788625258.929174:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625258.929265:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185162112 00000100:00100000:0.0:1788625258.929296:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185162112 00000100:00100000:0.0:1788625258.929409:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 39 00000100:00100000:0.0:1788625258.929422:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+34:12237:x1875509185162112:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:0.0:1788625258.930019:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+35:12237:x1875509185162112:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 598us (858us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788625258.930028:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 39 00000100:00100000:2.0:1788625259.045956:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625259.046077:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185162368 00000100:00100000:0.0:1788625259.046092:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185162368 00000100:00100000:0.0:1788625259.046176:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 163 00000100:00100000:0.0:1788625259.046189:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+35:12247:x1875509185162368:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:0.0:1788625259.046223:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625259.046252:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7add2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e2ba expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625259.046402:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788625259.047077:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7add2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2ba expref: 37 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.047096:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:0.0:1788625259.047099:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788625259.047105:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7add2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2ba expref: 37 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.047122:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae1c00, rc 0) 00000100:00100000:0.0:1788625259.047216:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+36:12247:x1875509185162368:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 1030us (1277us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1788625259.047226:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 163 00000100:00100000:1.0:1788625259.051423:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625259.051746:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185162496 00000100:00100000:0.0:1788625259.051778:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185162496 00000100:00100000:0.0:1788625259.051848:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 164 00000100:00100000:0.0:1788625259.052028:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+36:12247:x1875509185162496:12345-192.168.204.14@tcp:34:lfs.0 00010000:00010000:0.0:1788625259.052137:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ade0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.052161:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ade0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.052176:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ade0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.052190:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7ade7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.052197:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7ade7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.052205:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7ade7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.052314:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7adee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.052324:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7adee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.052331:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7adee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625259.052390:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7adee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.052419:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ade0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.052426:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ade0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.052435:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ade0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.052441:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625259.052446:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ade0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.052455:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ade0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.052469:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:0.0:1788625259.052472:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625259.052478:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ade0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.052485:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ade0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.053239:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7ade7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.053250:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7ade7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.053257:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7ade7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.053284:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625259.053288:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7ade7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.053294:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7ade7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.053307:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988749c9300) 00010000:00010000:0.0:1788625259.053310:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625259.053313:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7ade7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.053319:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7ade7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.053332:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7adee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.053338:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7adee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.053344:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7adee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.053349:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625259.053352:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7adee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.053357:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7adee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.053377:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625259.053380:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625259.053383:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7adee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.053389:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7adee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625259.055420:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+36:12247:x1875509185162496:12345-192.168.204.14@tcp:34:lfs.0 Request processed in 3542us (3992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625259.055437:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 164 00000100:00100000:3.0:1788625259.059953:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625259.060027:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185162752 00000100:00100000:0.0:1788625259.060046:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185162752 00000100:00100000:0.0:1788625259.060188:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 40 00000100:00100000:0.0:1788625259.060200:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+36:12247:x1875509185162752:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:0.0:1788625259.060573:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+37:12247:x1875509185162752:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 374us (640us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788625259.060590:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 40 00000100:00100000:2.0:1788625259.112741:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625259.113015:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185163008 00000100:00100000:1.0:1788625259.113028:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185163008 00000100:00100000:1.0:1788625259.113112:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 165 00000100:00100000:1.0:1788625259.113126:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+37:12251:x1875509185163008:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625259.113159:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625259.113189:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7adf5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e2c1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.113311:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7adfc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.113331:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7adfc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.113479:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7adfc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.113495:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.113503:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.113686:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.113852:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ae0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.113861:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ae0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.113869:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ae0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625259.113881:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788625259.114111:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7adfc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114121:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7adfc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114129:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7adfc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114135:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625259.114141:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7adfc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114150:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7adfc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114166:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:1.0:1788625259.114169:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625259.114185:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7adfc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114193:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7adfc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114210:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114217:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114222:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114227:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625259.114230:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114236:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114243:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988749c9300) 00010000:00010000:1.0:1788625259.114245:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625259.114248:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae03 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114253:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114318:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7adf5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2c1 expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114424:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ae0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2c1 expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.114432:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625259.114434:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625259.114436:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5400, rc 0) 00000100:00100000:1.0:1788625259.114758:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+39:12251:x1875509185163008:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 1632us (2033us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788625259.115216:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 165 00000100:00100000:2.0:1788625259.118851:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625259.119491:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185163136 00000100:00100000:1.0:1788625259.119504:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185163136 00000100:00100000:1.0:1788625259.119631:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 166 00000100:00100000:1.0:1788625259.119643:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+39:12251:x1875509185163136:12345-192.168.204.14@tcp:54:lfs.0 00010000:00010000:1.0:1788625259.119740:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7ae18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.119762:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7ae18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.119778:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7ae18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.119829:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7ae18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.119838:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7ae18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.119872:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7ae18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.119878:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625259.119884:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7ae18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.119893:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7ae18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.119908:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625259.119911:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625259.119917:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7ae18 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.119925:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7ae18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625259.120060:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+39:12251:x1875509185163136:12345-192.168.204.14@tcp:54:lfs.0 Request processed in 418us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625259.120069:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 166 00000100:00100000:3.0:1788625259.124697:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625259.124894:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185163392 00000100:00100000:2.0:1788625259.124908:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185163392 00000100:00100000:2.0:1788625259.124987:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 41 00000100:00100000:2.0:1788625259.124999:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+39:12251:x1875509185163392:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:2.0:1788625259.125354:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+40:12251:x1875509185163392:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 356us (672us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788625259.125362:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 41 00000100:00100000:1.0:1788625259.277021:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206198784:0@lo:400:kworker.0 00000100:00100000:1.0:1788625259.277136:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625259.277215:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206199296:0@lo:400:kworker.0 00000100:00100000:1.0:1788625259.277240:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625259.277256:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206199808:0@lo:400:kworker.0 00000100:00100000:1.0:1788625259.277322:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625259.277359:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788625259.277381:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206198912:0@lo:400:kworker.0 00000100:00100000:1.0:1788625259.277414:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625259.277434:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206199424:0@lo:400:kworker.0 00000100:00100000:1.0:1788625259.277455:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625259.277472:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206199936:0@lo:400:kworker.0 00000100:00100000:1.0:1788625259.277502:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625259.277566:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206198912 00000100:00100000:1.0:1788625259.277577:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206198912 00000100:00100000:1.0:1788625259.277639:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788625259.277650:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206198912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625259.277719:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206198912:12345-0@lo:400:kworker.0 Request processed in 70us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625259.277727:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788625259.277759:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206199936 00000100:00100000:1.0:1788625259.278104:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206199936 00000100:00100000:1.0:1788625259.278156:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788625259.278163:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206199936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625259.278201:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206199936:12345-0@lo:400:kworker.0 Request processed in 40us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625259.278208:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1788625259.278227:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625259.278302:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206198784 00000100:00100000:0.0:1788625259.278307:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206198784 00000100:00100000:0.0:1788625259.278337:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206199296 00000100:00100000:0.0:1788625259.278340:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206199296 00000100:00100000:0.0:1788625259.278356:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206199808 00000100:00100000:0.0:1788625259.278358:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206199808 00000100:00100000:0.0:1788625259.278371:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206199424 00000100:00100000:0.0:1788625259.278374:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206199424 00000100:00100000:0.0:1788625259.278394:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788625259.278401:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206198784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625259.278448:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206198784:12345-0@lo:400:kworker.0 Request processed in 49us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625259.278455:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788625259.278467:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788625259.278472:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206199296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625259.278493:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206199296:12345-0@lo:400:kworker.0 Request processed in 21us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625259.278503:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788625259.278534:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788625259.278541:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206199808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625259.278567:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206199808:12345-0@lo:400:kworker.0 Request processed in 27us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625259.278573:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788625259.278585:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788625259.278590:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206199424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625259.278616:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206199424:12345-0@lo:400:kworker.0 Request processed in 26us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625259.278622:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788625259.278721:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206198912:0@lo:400:kworker.0 00010000:00080000:0.0:1788625259.278738:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744286680 x1875509206199424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625259.278749:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206199424:0@lo:400:kworker.0 00000100:00100000:0.0:1788625259.278760:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206199936:0@lo:400:kworker.0 00000100:00100000:0.0:1788625259.278782:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206198784:0@lo:400:kworker.0 00000100:00100000:0.0:1788625259.278793:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206199296:0@lo:400:kworker.0 00010000:00080000:0.0:1788625259.278803:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744286300 x1875509206199808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625259.278811:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206199808:0@lo:400:kworker.0 00000100:00080000:1.0:1788625259.278912:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625259.278915:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625259.279141:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206198656:0@lo:400:kworker.0 00000100:00100000:3.0:1788625259.279195:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625259.279248:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206199168:0@lo:400:kworker.0 00000100:00100000:3.0:1788625259.279286:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625259.279358:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206199040:0@lo:400:kworker.0 00000100:00100000:2.0:1788625259.279400:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625259.279422:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206199552:0@lo:400:kworker.0 00000100:00100000:2.0:1788625259.279448:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625259.279462:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206200064:0@lo:400:kworker.0 00000100:00100000:2.0:1788625259.279484:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625259.279540:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206198656 00000100:00100000:1.0:1788625259.279547:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206198656 00000100:00100000:1.0:1788625259.279591:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788625259.279598:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206198656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625259.279647:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206198656:12345-0@lo:400:kworker.0 Request processed in 50us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625259.279654:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788625259.279873:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206199680:0@lo:400:kworker.0 00000100:00100000:3.0:1788625259.279902:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625259.279933:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206198656:0@lo:400:kworker.0 00000100:00100000:3.0:1788625259.279958:0:14517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206199168 00000100:00100000:3.0:1788625259.279962:0:14517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206199168 00000100:00100000:3.0:1788625259.279991:0:14517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788625259.279998:0:14517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206199168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625259.280278:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206199552 00000100:00100000:2.0:1788625259.280283:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206199552 00000100:00100000:2.0:1788625259.280318:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206200064 00000100:00100000:2.0:1788625259.280321:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206200064 00000100:00100000:2.0:1788625259.280352:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788625259.280358:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206199552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625259.280403:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206199552:12345-0@lo:400:kworker.0 Request processed in 45us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625259.280410:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788625259.280425:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788625259.280431:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206200064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625259.280463:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206200064:12345-0@lo:400:kworker.0 Request processed in 28us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625259.280469:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788625259.280498:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206199552:0@lo:400:kworker.0 00000100:00080000:1.0:1788625259.280498:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625259.280509:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206200064:0@lo:400:kworker.0 00000100:00100000:1.0:1788625259.280510:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206199040 00000100:00100000:1.0:1788625259.280513:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206199040 00000100:00100000:1.0:1788625259.280563:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206199680 00000100:00100000:1.0:1788625259.280567:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206199680 00000100:00100000:3.0:1788625259.280715:0:14517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206199168:12345-0@lo:400:kworker.0 Request processed in 717us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625259.280722:0:14517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788625259.280749:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206199168:0@lo:400:kworker.0 00000100:00100000:3.0:1788625259.280777:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788625259.280785:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206199040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625259.280832:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206199040:12345-0@lo:400:kworker.0 Request processed in 48us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625259.280839:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788625259.280852:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788625259.280859:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206199680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625259.280890:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206199680:12345-0@lo:400:kworker.0 Request processed in 32us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625259.280896:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788625259.280909:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206199680:0@lo:400:kworker.0 00000100:00100000:2.0:1788625259.281085:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206199040:0@lo:400:kworker.0 00000100:00080000:2.0:1788625259.281104:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625259.359568:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625259.359843:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185163648 00000100:00100000:0.0:1788625259.359857:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185163648 00000100:00100000:0.0:1788625259.359992:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 167 00000100:00100000:0.0:1788625259.360013:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+40:12282:x1875509185163648:12345-192.168.204.14@tcp:101:cat.0 00010000:00010000:0.0:1788625259.360049:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625259.360079:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7ae1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e2c8 expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.360235:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7ae26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.360255:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7ae26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.360281:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7ae26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625259.360295:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788625259.360442:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7ae1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2c8 expref: 43 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.360466:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7ae26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2c8 expref: 42 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.360497:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625259.360500:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625259.360505:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae0a00, rc 0) 00000100:00100000:0.0:1788625259.360652:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:12282:x1875509185163648:12345-192.168.204.14@tcp:101:cat.0 Request processed in 649us (1143us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788625259.360659:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 167 00000100:00100000:2.0:1788625259.367736:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625259.367823:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625259.367923:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185163904 00000100:00100000:0.0:1788625259.367939:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185163904 00000100:00100000:0.0:1788625259.368022:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 42 00000100:00100000:0.0:1788625259.368034:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:12282:x1875509185163904:12345-192.168.204.14@tcp:35:cat.0 00000100:00100000:0.0:1788625259.368379:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+43:12282:x1875509185163904:12345-192.168.204.14@tcp:35:cat.0 Request processed in 346us (663us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1788625259.368387:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 42 00000100:00100000:1.0:1788625259.368768:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185164032 00000100:00100000:1.0:1788625259.368776:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185164032 00000100:00100000:1.0:1788625259.368827:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00100000:1.0:1788625259.368837:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+43:2391:x1875509185164032:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625259.368850:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625259.368881:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7ae26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2c8 expref: 43 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.368902:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625259.368908:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625259.368951:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:2391:x1875509185164032:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 116us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625259.368957:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00100000:2.0:1788625259.425001:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625259.426305:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185164288 00000100:00100000:1.0:1788625259.426322:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185164288 00000100:00100000:1.0:1788625259.426427:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 168 00000100:00100000:1.0:1788625259.426438:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:12288:x1875509185164288:12345-192.168.204.14@tcp:101:dd.0 00010000:00010000:1.0:1788625259.426471:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625259.426493:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788625259.426576:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7ad8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e29e expref: 42 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.426600:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:1.0:1788625259.426606:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625259.426623:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7ae34 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e2cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.426768:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.426784:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ae0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2c1 expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.426793:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.426831:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ae0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2c1 expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.426845:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ae0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2c1 expref: 42 pid: 6513 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625259.426861:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206200192:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625259.428468:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885eefa540 going to sleep for 11 seconds 00000100:00100000:3.0:1788625259.435157:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625259.435347:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206200192:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625259.435385:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625259.436459:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185164416 00000100:00100000:0.0:1788625259.436471:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185164416 00010000:00010000:0.0:1788625259.436568:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ae0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2c1 expref: 43 pid: 6513 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625259.436637:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 85 00000100:00100000:0.0:1788625259.436650:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744278a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+43:2394:x1875509185164416:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625259.436672:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625259.436680:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ae0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2c1 expref: 43 pid: 6513 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.436697:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ae0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2c1 expref: 43 pid: 6513 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.436748:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7ae0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2c1 expref: 43 pid: 6513 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.436768:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625259.436773:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.436783:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.436792:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.437220:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625259.437331:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744278a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:2394:x1875509185164416:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 681us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625259.437342:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 85 00010000:00010000:1.0:1788625259.440462:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.440489:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625259.440580:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788625259.441187:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7ae34 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2cf expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.441217:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2cf expref: 42 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.441228:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625259.441232:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788625259.441237:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5200, rc 0) 00000100:00100000:1.0:1788625259.441493:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:12288:x1875509185164288:12345-192.168.204.14@tcp:101:dd.0 Request processed in 15055us (16504us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788625259.441505:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 168 00000100:00100000:3.0:1788625259.444903:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625259.447069:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185164544 00000100:00100000:0.0:1788625259.447091:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185164544 00000100:00100000:0.0:1788625259.447191:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 169 00000100:00100000:0.0:1788625259.447206:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:12288:x1875509185164544:12345-192.168.204.14@tcp:101:dd.0 00010000:00010000:0.0:1788625259.447241:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625259.447285:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7ae49 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e2d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.447833:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ae50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.447879:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ae50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.447895:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ae50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.448184:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7ae49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2d6 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.448211:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ae50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2d6 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.448222:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625259.448225:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788625259.448230:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae1200, rc 0) 00000100:00100000:0.0:1788625259.448341:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+43:12288:x1875509185164544:12345-192.168.204.14@tcp:101:dd.0 Request processed in 1138us (3455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625259.448351:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 169 00000100:00100000:2.0:1788625259.452235:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625259.453293:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185164800 00000100:00100000:0.0:1788625259.453309:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185164800 00000100:00100000:0.0:1788625259.453406:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 170 00000100:00100000:0.0:1788625259.453419:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+43:12288:x1875509185164800:12345-192.168.204.14@tcp:36:dd.0 00010000:00010000:0.0:1788625259.453819:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7ae57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.453842:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7ae57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.453871:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7ae57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788625259.453927:0:9824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1788625259.453955:0:9824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cddea38f reply state 00000000859961ab transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7ae57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.453972:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7ae57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.453982:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625259.453986:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788625259.453991:0:9824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788625259.455566:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+46:12288:x1875509185164800:12345-192.168.204.14@tcp:36:dd.0 Request processed in 2133us (3331us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1788625259.455580:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 170 00000020:00080000:0.0:1788625259.455587:0:9824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788625259.596482:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625259.708194:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625259.708350:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185164928 00000100:00100000:1.0:1788625259.708361:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185164928 00000100:00100000:1.0:1788625259.708427:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 171 00000100:00100000:1.0:1788625259.708438:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+46:12302:x1875509185164928:12345-192.168.204.14@tcp:101:stat.0 00010000:00010000:1.0:1788625259.708461:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625259.708486:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7ae5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e2dd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.708702:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae65 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.708717:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.708729:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.708740:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7ae6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.708746:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7ae6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.708752:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7ae6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.709108:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ae73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.709119:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2cf expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.709128:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ae73 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.709163:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2cf expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.709341:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2cf expref: 47 pid: 6511 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625259.709355:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206200320:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625259.709463:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885eefa540 going to sleep for 11 seconds 00000100:00100000:3.0:1788625259.712013:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625259.712125:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185165184 00000100:00100000:0.0:1788625259.712137:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185165184 00000100:00100000:1.0:1788625259.712323:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206200320:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625259.712357:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ae73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625259.712416:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 43 00000100:00100000:0.0:1788625259.712427:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+48:6162:x1875509185165184:12345-192.168.204.14@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788625259.712867:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+49:6162:x1875509185165184:12345-192.168.204.14@tcp:35:ldlm_bl.0 Request processed in 440us (866us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788625259.712876:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 43 00000100:00100000:2.0:1788625259.718202:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625259.718293:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185165312 00000100:00100000:0.0:1788625259.718308:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185165312 00010000:00010000:0.0:1788625259.718367:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2cf expref: 49 pid: 6511 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625259.718506:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 86 00000100:00100000:0.0:1788625259.718569:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858352680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+49:2394:x1875509185165312:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625259.718590:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625259.718599:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2cf expref: 49 pid: 6511 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.718615:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2cf expref: 49 pid: 6511 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.718644:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7ae3b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2cf expref: 49 pid: 6511 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.718664:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625259.718671:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ae73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.718682:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ae73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.718691:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ae73 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.718736:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625259.718816:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858352680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+48:2394:x1875509185165312:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 299us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625259.718825:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 86 00010000:00010000:2.0:1788625259.718891:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ae73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.718900:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ae73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625259.719135:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788625259.719141:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625259.719168:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ae73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719184:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ae73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719196:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719204:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae65 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719210:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719216:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625259.719222:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719231:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae65 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719252:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:2.0:1788625259.719255:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625259.719270:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719277:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4a00/0x2d2e3b3f34a7ae65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719288:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7ae6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719294:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7ae6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719300:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7ae6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719306:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625259.719309:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7ae6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719315:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7ae6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719324:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988749c9300) 00010000:00010000:2.0:1788625259.719326:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625259.719328:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7ae6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719334:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7ae6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719393:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7ae5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2dd expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719408:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ae73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2dd expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.719416:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:2.0:1788625259.719418:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625259.719421:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5a00, rc 0) 00000100:00100000:2.0:1788625259.719472:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+47:12302:x1875509185164928:12345-192.168.204.14@tcp:101:stat.0 Request processed in 11037us (11290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625259.719481:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 171 00000100:00100000:2.0:1788625259.770378:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625259.770504:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185165568 00000100:00100000:0.0:1788625259.770592:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185165568 00000100:00100000:1.0:1788625259.770903:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 172 00000100:00100000:1.0:1788625259.770920:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+47:12308:x1875509185165568:12345-192.168.204.14@tcp:36:truncate.0 00010000:00010000:1.0:1788625259.771008:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625259.771047:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7ae73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2dd expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.771072:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625259.771078:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625259.771486:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7ae7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.771505:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7ae7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.771624:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7ae7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625259.771704:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1788625259.771737:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aaafc187 reply state 000000004a2257c2 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7ae7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.771765:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7ae7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625259.771772:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625259.771775:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788625259.771778:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625259.771956:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+49:12308:x1875509185165568:12345-192.168.204.14@tcp:36:truncate.0 Request processed in 1040us (1591us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788625259.771966:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 172 00000020:00080000:1.0:1788625259.771973:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788625259.787904:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206200448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625259.788012:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625259.788141:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206200448 00000100:00100000:1.0:1788625259.788152:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206200448 00000100:00100000:1.0:1788625259.788224:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788625259.788235:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206200448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788625259.788289:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788625259.788347:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206200448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625259.788356:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788625259.788412:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206200448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625259.788476:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625259.788489:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206200576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625259.788541:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625259.788551:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206200704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625259.788584:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625259.788616:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625259.788648:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206200576 00000100:00100000:2.0:1788625259.788652:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206200576 00000100:00100000:2.0:1788625259.788698:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788625259.788706:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206200576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788625259.788739:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788625259.788784:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206200576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625259.788791:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788625259.788920:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206200704 00000100:00100000:1.0:1788625259.788924:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206200704 00000100:00100000:0.0:1788625259.788933:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206200576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625259.790401:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788625259.790425:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206200704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788625259.790458:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788625259.790590:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206200704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625259.790598:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788625259.790666:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206200704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625259.910560:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625259.910653:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185165696 00000100:00100000:0.0:1788625259.910676:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185165696 00000100:00100000:0.0:1788625259.910789:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 173 00000100:00100000:0.0:1788625259.910804:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+49:12322:x1875509185165696:12345-192.168.204.14@tcp:101:stat.0 00010000:00010000:0.0:1788625259.910848:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625259.910885:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7ae81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e2e4 expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911002:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7ae88 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911023:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7ae88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911044:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7ae88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911057:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7ae8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911064:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7ae8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911070:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7ae8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911617:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7ae96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911629:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7ae96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911637:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7ae96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625259.911692:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788625259.911697:0:9824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625259.911721:0:9824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7ae96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911734:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7ae96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911744:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7ae88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911750:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7ae88 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911757:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7ae88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911762:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625259.911767:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7ae88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911775:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7ae88 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911799:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:0.0:1788625259.911802:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625259.911809:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7ae88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911815:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7ae88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911833:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7ae8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911840:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7ae8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911846:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7ae8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911850:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625259.911853:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7ae8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911857:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7ae8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911863:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988749c9300) 00010000:00010000:0.0:1788625259.911865:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625259.911868:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7ae8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911874:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7ae8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911916:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7ae81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2e4 expref: 51 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911930:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7ae96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2e4 expref: 50 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625259.911938:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625259.911940:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625259.911943:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae0c00, rc 0) 00000100:00100000:0.0:1788625259.912116:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+50:12322:x1875509185165696:12345-192.168.204.14@tcp:101:stat.0 Request processed in 1315us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625259.912125:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 173 00000100:00100000:3.0:1788625259.998493:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625259.999064:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185165952 00000100:00100000:2.0:1788625259.999075:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185165952 00000100:00100000:2.0:1788625259.999273:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 174 00000100:00100000:2.0:1788625259.999285:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+50:12332:x1875509185165952:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625259.999305:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625259.999327:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7ae9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e2eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625259.999428:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788625259.999552:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7ae9d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2eb expref: 52 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.999578:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:2.0:1788625259.999581:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625259.999586:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7ae9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2eb expref: 52 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625259.999601:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744189200, rc 0) 00000100:00100000:2.0:1788625259.999671:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+51:12332:x1875509185165952:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 389us (1187us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1788625259.999679:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 174 00000100:00100000:2.0:1788625260.003094:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625260.003179:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185166208 00000100:00100000:0.0:1788625260.003189:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185166208 00000100:00100000:0.0:1788625260.003310:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 44 00000100:00100000:0.0:1788625260.003333:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866f54450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+51:12332:x1875509185166208:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:0.0:1788625260.003609:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866f54450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+52:12332:x1875509185166208:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 288us (525us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1788625260.003617:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 44 00000100:00080000:2.0:1788625260.005201:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625260.073037:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625260.073140:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185166464 00000100:00100000:1.0:1788625260.073155:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185166464 00000100:00100000:1.0:1788625260.073357:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 175 00000100:00100000:1.0:1788625260.073371:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+52:12338:x1875509185166464:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:1.0:1788625260.073406:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625260.073436:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7aeab lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e2f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.073633:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.073653:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7ae96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2e4 expref: 53 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.073663:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.073707:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7ae96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2e4 expref: 53 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.073724:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7ae96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2e4 expref: 53 pid: 9824 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625260.073766:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744229500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206200832:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625260.073905:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861300 going to sleep for 11 seconds 00000100:00100000:3.0:1788625260.075663:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744229500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206200832:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625260.075693:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625260.076349:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625260.076432:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185166592 00000100:00100000:1.0:1788625260.076446:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185166592 00010000:00010000:1.0:1788625260.076503:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7ae96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2e4 expref: 54 pid: 9824 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625260.076601:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 87 00000100:00100000:1.0:1788625260.076613:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+54:2394:x1875509185166592:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625260.076632:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625260.076641:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7ae96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2e4 expref: 54 pid: 9824 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.076657:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7ae96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2e4 expref: 54 pid: 9824 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.076689:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7ae96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2e4 expref: 54 pid: 9824 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.076710:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625260.076715:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.076728:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.076761:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.076798:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625260.076831:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625260.076843:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625260.076871:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+53:2394:x1875509185166592:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 258us (521us total) trans 0 rc 0/0 00000004:00200000:3.0:1788625260.076872:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000100:00100000:1.0:1788625260.076881:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 87 00010000:00010000:3.0:1788625260.077029:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7aeab lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2f2 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625260.077051:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2f2 expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625260.077061:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:3.0:1788625260.077064:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788625260.077068:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5600, rc 0) 00000100:00100000:3.0:1788625260.077115:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+53:12338:x1875509185166464:12345-192.168.204.14@tcp:101:bash.0 Request processed in 3748us (4094us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788625260.077124:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 175 00000100:00100000:3.0:1788625260.081934:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625260.082269:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185166848 00000100:00100000:0.0:1788625260.082281:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185166848 00000100:00100000:0.0:1788625260.082440:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 176 00000100:00100000:0.0:1788625260.082450:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+53:12338:x1875509185166848:12345-192.168.204.14@tcp:36:bash.0 00010000:00010000:0.0:1788625260.082749:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7aec0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.082771:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7aec0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.082784:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7aec0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788625260.082841:0:9824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788625260.082865:0:9824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000399dfead reply state 00000000956406ad transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7aec0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.082879:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7aec0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.082887:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625260.082890:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788625260.082894:0:9824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788625260.083007:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+56:12338:x1875509185166848:12345-192.168.204.14@tcp:36:bash.0 Request processed in 557us (1081us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788625260.083015:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 176 00000020:00080000:0.0:1788625260.083020:0:9824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788625260.091727:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625260.092169:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185166976 00000100:00100000:1.0:1788625260.092194:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185166976 00000100:00100000:1.0:1788625260.092307:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 177 00000100:00100000:1.0:1788625260.092319:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+56:12338:x1875509185166976:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:1.0:1788625260.092356:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625260.092386:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7aec7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e2f9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.092570:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7aece lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.092590:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2f2 expref: 57 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.092601:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7aece lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.092668:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2f2 expref: 57 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.092932:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2f2 expref: 57 pid: 6512 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625260.092971:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206200960:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625260.093224:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625260.096285:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1875509206200960:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625260.096332:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7aece lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625260.096469:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625260.096925:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185167104 00000100:00100000:0.0:1788625260.096937:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185167104 00010000:00010000:0.0:1788625260.097000:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2f2 expref: 58 pid: 6512 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625260.097039:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 88 00000100:00100000:0.0:1788625260.097050:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:2394:x1875509185167104:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625260.097104:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625260.097115:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2f2 expref: 58 pid: 6512 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.097132:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2f2 expref: 58 pid: 6512 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.097177:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7aeb2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2f2 expref: 58 pid: 6512 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.097201:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625260.097207:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7aece lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.097231:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7aece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.097241:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7aece lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.097282:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625260.097309:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7aece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.097318:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7aece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625260.097358:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+57:2394:x1875509185167104:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 309us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625260.097367:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 88 00000004:00200000:1.0:1788625260.097391:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788625260.097398:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625260.097513:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7aece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.097596:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7aec7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2f9 expref: 57 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.097614:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7aece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2f9 expref: 56 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.097623:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625260.097626:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625260.097629:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4400, rc 0) 00000100:00100000:1.0:1788625260.097658:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+56:12338:x1875509185166976:12345-192.168.204.14@tcp:101:bash.0 Request processed in 5342us (5939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625260.097675:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 177 00000100:00100000:2.0:1788625260.104399:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625260.104590:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185167360 00000100:00100000:0.0:1788625260.104604:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185167360 00000100:00100000:0.0:1788625260.104666:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 45 00000100:00100000:0.0:1788625260.104676:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+56:12338:x1875509185167360:12345-192.168.204.14@tcp:35:bash.0 00000100:00100000:0.0:1788625260.105098:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+57:12338:x1875509185167360:12345-192.168.204.14@tcp:35:bash.0 Request processed in 421us (712us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788625260.105107:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 45 00000100:00100000:3.0:1788625260.155173:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625260.155688:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185167616 00000100:00100000:1.0:1788625260.155704:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185167616 00000100:00100000:1.0:1788625260.155792:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 178 00000100:00100000:1.0:1788625260.155805:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+57:12348:x1875509185167616:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625260.156036:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625260.156068:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7aed5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e300 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625260.156488:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788625260.156689:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7aed5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e300 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.156711:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:1.0:1788625260.156715:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625260.156722:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7aed5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e300 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.156743:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4200, rc 0) 00000100:00100000:1.0:1788625260.156994:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:12348:x1875509185167616:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 1191us (1833us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1788625260.157004:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 178 00000100:00100000:3.0:1788625260.159781:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625260.159944:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185167744 00000100:00100000:0.0:1788625260.159970:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185167744 00000100:00100000:0.0:1788625260.160052:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 179 00000100:00100000:0.0:1788625260.160065:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:12348:x1875509185167744:12345-192.168.204.14@tcp:34:lfs.0 00010000:00010000:0.0:1788625260.160171:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7aee3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.160193:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7aee3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.160210:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7aee3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.160224:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7aeea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.160231:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7aeea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.160237:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7aeea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.160344:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7aef1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.160356:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7aef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.160399:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7aef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625260.160464:0:9824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7aef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.160480:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7aee3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.160487:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7aee3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.160494:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7aee3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.160502:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625260.160507:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7aee3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161223:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7aee3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161246:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:0.0:1788625260.161274:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625260.161281:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7aee3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161289:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7aee3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161309:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7aeea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161326:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7aeea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161333:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7aeea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161338:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625260.161342:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7aeea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161349:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7aeea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161358:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988749c9300) 00010000:00010000:0.0:1788625260.161361:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625260.161364:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7aeea lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161370:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7aeea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161684:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7aef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161693:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7aef1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161700:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7aef1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161706:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625260.161717:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7aef1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161724:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7aef1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161734:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625260.161738:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625260.161741:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7aef1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.161748:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7aef1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625260.162664:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:12348:x1875509185167744:12345-192.168.204.14@tcp:34:lfs.0 Request processed in 2590us (2884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625260.162679:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 179 00000100:00100000:2.0:1788625260.168795:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625260.169111:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185168000 00000100:00100000:3.0:1788625260.169126:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185168000 00000100:00100000:3.0:1788625260.169198:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 46 00000100:00100000:3.0:1788625260.169213:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:12348:x1875509185168000:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:3.0:1788625260.169515:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:12348:x1875509185168000:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 307us (735us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788625260.170043:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 46 00000100:00100000:3.0:1788625260.207697:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625260.209259:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185168256 00000100:00100000:1.0:1788625260.209280:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185168256 00000100:00100000:1.0:1788625260.209383:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 180 00000100:00100000:1.0:1788625260.209399:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:12351:x1875509185168256:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625260.209462:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625260.209493:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7aef8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e307 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.209629:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7aeff lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.209648:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7aeff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.209663:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7aeff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.209677:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.209685:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.209691:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.209844:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7af0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.209855:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7af0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.209862:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7af0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625260.209873:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788625260.210012:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7aeff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210022:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7aeff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210030:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7aeff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210037:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625260.210043:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7aeff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210052:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7aeff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210067:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:1.0:1788625260.210071:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625260.210077:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7aeff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210085:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7aeff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210100:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210107:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af06 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210114:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210119:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625260.210130:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210137:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210146:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988749c9300) 00010000:00010000:1.0:1788625260.210149:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625260.210152:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af06 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210159:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210205:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7aef8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e307 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210221:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7af0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e307 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.210229:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625260.210232:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625260.210235:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4600, rc 0) 00000100:00100000:1.0:1788625260.210339:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:12351:x1875509185168256:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 945us (2955us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788625260.210347:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 180 00000100:00100000:2.0:1788625260.214044:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625260.214100:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625260.214208:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185168384 00000100:00100000:1.0:1788625260.214221:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185168384 00000100:00100000:0.0:1788625260.214261:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185168512 00000100:00100000:0.0:1788625260.214267:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185168512 00000100:00100000:0.0:1788625260.214330:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 13 00000100:00100000:0.0:1788625260.214342:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+62:2392:x1875509185168512:12345-192.168.204.14@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788625260.214362:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 181 00010000:00010000:0.0:1788625260.214366:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788625260.214376:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+62:12351:x1875509185168384:12345-192.168.204.14@tcp:54:lfs.0 00010000:00010000:0.0:1788625260.214405:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7af0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e307 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625260.214431:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625260.214439:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625260.214484:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.214504:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.214565:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625260.214609:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:2392:x1875509185168512:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 177us (415us total) trans 0 rc 0/0 00010000:00010000:1.0:1788625260.214610:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.214622:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af1b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.214636:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625260.214638:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 13 00010000:00010000:1.0:1788625260.214648:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625260.214654:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.214663:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.214672:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625260.214675:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625260.214679:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af1b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.214686:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625260.214756:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:12351:x1875509185168384:12345-192.168.204.14@tcp:54:lfs.0 Request processed in 385us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625260.214764:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 181 00000100:00100000:2.0:1788625260.217909:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625260.218051:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185168768 00000100:00100000:0.0:1788625260.218064:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185168768 00000100:00100000:0.0:1788625260.218310:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 47 00000100:00100000:0.0:1788625260.218324:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:12351:x1875509185168768:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:0.0:1788625260.218708:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:12351:x1875509185168768:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 386us (812us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788625260.218717:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 47 00000100:00100000:0.0:1788625260.355089:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625260.355212:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185169024 00000100:00100000:1.0:1788625260.355225:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185169024 00000100:00100000:1.0:1788625260.355362:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 182 00000100:00100000:1.0:1788625260.355376:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+61:12369:x1875509185169024:12345-192.168.204.14@tcp:101:cat.0 00010000:00010000:1.0:1788625260.355410:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625260.355440:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e30e expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.355651:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7af29 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.355672:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7af29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.355687:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7af29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625260.355701:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788625260.355852:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e30e expref: 64 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.355877:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7af29 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e30e expref: 63 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.355886:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625260.355909:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788625260.355916:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4200, rc 0) 00000100:00100000:1.0:1788625260.356005:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:12369:x1875509185169024:12345-192.168.204.14@tcp:101:cat.0 Request processed in 632us (932us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1788625260.356012:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 182 00000100:00100000:3.0:1788625260.384412:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625260.384563:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185169152 00000100:00100000:1.0:1788625260.384577:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185169152 00000100:00100000:1.0:1788625260.384659:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 183 00000100:00100000:1.0:1788625260.384672:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:12370:x1875509185169152:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625260.384706:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625260.384736:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e315 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.384828:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.384849:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.384864:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625260.384928:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788625260.385138:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625260.385168:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.385204:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e315 expref: 65 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.385264:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e315 expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.385274:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:1.0:1788625260.385278:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625260.385282:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5600, rc 0) 00000100:00100000:1.0:1788625260.385370:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+64:12370:x1875509185169152:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 700us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625260.385379:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 183 00000100:00100000:2.0:1788625260.391190:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625260.391346:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185169536 00000100:00100000:3.0:1788625260.391360:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185169536 00000100:00100000:3.0:1788625260.391437:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 48 00000100:00100000:3.0:1788625260.391471:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+64:12370:x1875509185169536:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:3.0:1788625260.391915:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:12370:x1875509185169536:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 445us (738us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788625260.391924:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 48 00000100:00100000:0.0:1788625260.395218:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625260.395400:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185169664 00000100:00100000:1.0:1788625260.395412:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185169664 00000100:00100000:1.0:1788625260.395582:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00100000:1.0:1788625260.395593:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:12370:x1875509185169664:12345-192.168.204.14@tcp:103:lfs.0 00010000:00010000:1.0:1788625260.395611:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788625260.395638:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7aece lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2f9 expref: 65 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.395660:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7af29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e30e expref: 64 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.395671:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7adcb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2b3 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.395682:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625260.395687:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625260.395932:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+62:12370:x1875509185169664:12345-192.168.204.14@tcp:103:lfs.0 Request processed in 339us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625260.395940:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00100000:0.0:1788625260.402030:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625260.402273:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185169792 00000100:00100000:3.0:1788625260.402284:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185169792 00000100:00100000:3.0:1788625260.402359:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 184 00000100:00100000:3.0:1788625260.402370:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+62:12370:x1875509185169792:12345-192.168.204.14@tcp:58:lfs.0 00010000:00010000:3.0:1788625260.402795:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7af45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625260.402815:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7af45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625260.402829:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7af45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625260.402972:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788625260.403119:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+62:12370:x1875509185169792:12345-192.168.204.14@tcp:58:lfs.0 Request processed in 750us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625260.403129:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 184 00000100:00100000:3.0:1788625260.438893:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625260.439015:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185169920 00000100:00100000:1.0:1788625260.439026:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185169920 00000100:00100000:1.0:1788625260.439092:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 185 00000100:00100000:1.0:1788625260.439104:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+62:12372:x1875509185169920:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625260.439126:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625260.439149:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7af4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e31c expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439220:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7af53 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439235:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7af53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439258:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7af53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439270:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439277:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439283:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439360:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439389:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439396:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625260.439438:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788625260.439442:0:9824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625260.439459:0:9824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439471:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439479:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7af53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439486:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7af53 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439493:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7af53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439499:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625260.439503:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7af53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439511:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7af53 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439566:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:1.0:1788625260.439570:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625260.439581:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7af53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439588:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7af53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439601:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439608:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439614:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439620:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625260.439622:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439628:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439636:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988749c9300) 00010000:00010000:1.0:1788625260.439638:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625260.439641:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439646:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439674:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7af4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e31c expref: 64 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439700:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e31c expref: 63 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625260.439707:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625260.439709:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625260.439712:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5a00, rc 0) 00000100:00100000:1.0:1788625260.439768:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:12372:x1875509185169920:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 666us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625260.439775:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 185 00010000:00010000:1.0:1788625260.620479:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625261.158075:0:14701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788625261.158084:0:14701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788625261.158123:0:14701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788625261.158130:0:14701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788625261.259661:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788625261.259672:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625261.259784:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788625261.259806:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788625261.259954:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441f9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1875509206201088:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788625261.260068:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bc900 going to sleep for 11 seconds 00000100:00100000:2.0:1788625261.266607:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441f9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1875509206201088:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788625261.273868:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.274252:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185170048 00000100:00100000:1.0:1788625261.274264:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185170048 00000100:00100000:1.0:1788625261.274327:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 186 00000100:00100000:1.0:1788625261.274339:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:12384:x1875509185170048:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788625261.274373:0:6511:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788625261.274510:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:12384:x1875509185170048:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 Request processed in 164us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625261.274543:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 186 00000100:00100000:2.0:1788625261.284348:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625261.284394:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185170176 00000100:00100000:2.0:1788625261.284405:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185170176 00000100:00100000:2.0:1788625261.284471:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 187 00000100:00100000:2.0:1788625261.284598:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:12384:x1875509185170176:12345-192.168.204.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788625261.284704:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7af68 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.284722:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7af68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.284737:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7af68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.284768:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7af6f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.284776:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7af6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.284783:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7af6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.284833:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7af76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.284843:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7af76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.284851:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7af76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625261.284898:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788625261.284902:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625261.284916:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7af76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.284928:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7af68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.284935:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7af68 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.284942:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7af68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.284948:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625261.284952:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7af68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.284960:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7af68 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.284973:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998743548200) 00010000:00010000:2.0:1788625261.284982:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625261.284988:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7af68 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.285006:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189400/0x2d2e3b3f34a7af68 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.285019:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7af6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.285024:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7af6f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.285031:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7af6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.285037:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625261.285040:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7af6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.285327:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7af6f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.285339:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9988625bed00) 00010000:00010000:2.0:1788625261.285342:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625261.285345:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7af6f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.285351:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7af6f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.285369:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7af76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.285380:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7af76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.285387:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7af76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.285392:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625261.285396:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7af76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.285403:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7af76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.285411:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:2.0:1788625261.285414:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625261.285417:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7af76 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.285423:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7af76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625261.287154:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:12384:x1875509185170176:12345-192.168.204.14@tcp:34:lhsmtool_posix.0 Request processed in 2669us (2810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625261.287167:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 187 00000100:00100000:2.0:1788625261.297210:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.299953:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185170432 00000100:00100000:1.0:1788625261.299967:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185170432 00000100:00100000:1.0:1788625261.300031:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 188 00000100:00100000:1.0:1788625261.300041:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:12384:x1875509185170432:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625261.300061:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625261.300084:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7af7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e323 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.300208:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.300235:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.300248:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625261.300260:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788625261.300336:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.300345:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.300352:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.300358:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625261.300362:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.300371:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.300384:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625261.300387:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625261.300392:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.300409:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7af84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.300451:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7af7d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e323 expref: 65 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.300462:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998743548200) 00010000:00010000:1.0:1788625261.300464:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625261.300468:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7af7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e323 expref: 65 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.300477:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5000, rc 0) 00000100:00100000:1.0:1788625261.300553:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+64:12384:x1875509185170432:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 514us (3356us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1788625261.300561:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 188 00000100:00100000:3.0:1788625261.306791:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.306882:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185170560 00000100:00100000:1.0:1788625261.306892:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185170560 00000100:00100000:1.0:1788625261.306955:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 189 00000100:00100000:1.0:1788625261.306966:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+64:12384:x1875509185170560:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788625261.307127:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788625261.307255:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+64:12384:x1875509185170560:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 Request processed in 290us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625261.307262:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 189 00000100:00100000:1.0:1788625261.314457:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625261.318165:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185170816 00000100:00100000:2.0:1788625261.318180:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185170816 00000100:00100000:2.0:1788625261.318309:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 190 00000100:00100000:2.0:1788625261.318321:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+64:12384:x1875509185170816:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625261.318351:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625261.318355:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788625261.318382:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7af3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e315 expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.318401:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:2.0:1788625261.318412:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625261.318427:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7af92 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e32a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788625261.318828:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788625261.318989:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7af99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.320157:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7af99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.320172:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7af99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.320268:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7af92 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e32a expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.320428:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7af99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e32a expref: 65 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.320441:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9988625bed00) 00010000:00010000:2.0:1788625261.320445:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625261.320456:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188400, rc 0) 00000100:00100000:2.0:1788625261.320603:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:12384:x1875509185170816:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 2284us (6156us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788625261.320614:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 190 00000100:00100000:2.0:1788625261.326206:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.326272:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185171072 00000100:00100000:1.0:1788625261.326284:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185171072 00000100:00100000:1.0:1788625261.326367:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 191 00000100:00100000:1.0:1788625261.326377:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:12384:x1875509185171072:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788625261.326437:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625261.326466:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7af99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e32a expref: 65 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326487:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9988625bed00) 00010000:00010000:1.0:1788625261.326501:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625261.326561:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7afa7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326577:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7afa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326588:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7afa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326651:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7afae lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x23f849bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326659:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7afae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x23f849bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326667:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7afae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x23f849bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326717:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7afa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326725:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7afa7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326873:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7afa7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326879:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625261.326884:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7afa7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326892:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7afa7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326901:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:1.0:1788625261.326905:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625261.326909:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7afa7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326916:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7afa7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326927:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7afae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x23f849bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326933:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7afae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x23f849bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326939:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7afae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x23f849bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326945:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625261.326948:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7afae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x23f849bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326964:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7afae lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x23f849bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326973:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x23f849bc (ffff9987410b7400) 00010000:00010000:1.0:1788625261.326975:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625261.326978:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7afae lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x23f849bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.326984:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7afae lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x23f849bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625261.327071:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+64:12384:x1875509185171072:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 694us (874us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788625261.327079:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 191 00000100:00100000:2.0:1788625261.334316:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.334417:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185171200 00000100:00100000:1.0:1788625261.334427:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185171200 00000100:00100000:1.0:1788625261.334866:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 192 00000100:00100000:1.0:1788625261.334878:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+64:12384:x1875509185171200:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625261.334899:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625261.334924:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7afb5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e331 expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.334962:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7afbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.334977:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7afbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.334989:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7afbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.335114:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7afb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e331 expref: 66 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.335132:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7afbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e331 expref: 65 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.335142:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9987410b7500) 00010000:00010000:1.0:1788625261.335145:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788625261.335149:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5200, rc 0) 00000100:00100000:1.0:1788625261.335207:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:12384:x1875509185171200:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 331us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625261.335215:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 192 00000100:00100000:2.0:1788625261.339642:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625261.339702:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185171456 00000100:00100000:0.0:1788625261.339713:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185171456 00000100:00100000:0.0:1788625261.339773:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 193 00000100:00100000:0.0:1788625261.339783:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:12384:x1875509185171456:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788625261.339878:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7afc3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.339897:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7afc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.339911:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7afc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625261.340148:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788625261.340159:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382447641217ns, next at 383447638107ns, rc = 0 00000004:00010000:0.0:1788625261.340213:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1234c7f reply state 00000000e9da14d3 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7afc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.340237:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7afc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.340245:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9987410b7500) 00010000:00010000:0.0:1788625261.340249:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788625261.340253:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788625261.340367:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:12384:x1875509185171456:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 584us (736us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788625261.340375:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 193 00000100:00100000:2.0:1788625261.349505:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.349681:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185171584 00000100:00100000:1.0:1788625261.349694:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185171584 00000100:00100000:1.0:1788625261.349832:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 194 00000100:00100000:1.0:1788625261.349843:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:12384:x1875509185171584:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625261.349880:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625261.349912:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7afca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e338 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.349980:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7afca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e338 expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.349997:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7afca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e338 expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.350041:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9987410b7500) 00010000:00010000:1.0:1788625261.350045:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625261.350049:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4000, rc 0) 00000100:00100000:1.0:1788625261.350161:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+68:12384:x1875509185171584:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 319us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625261.350169:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 194 00000100:00100000:2.0:1788625261.359940:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.360128:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185171712 00000100:00100000:1.0:1788625261.360141:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185171712 00000100:00100000:1.0:1788625261.360234:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 58 00000100:00100000:1.0:1788625261.360246:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2394:x1875509185171712:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788625261.360484:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2394:x1875509185171712:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 Request processed in 239us (554us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788625261.360493:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 58 00000100:00080000:2.0:1788625261.360643:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625261.363450:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625261.363605:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185171968 00000100:00100000:0.0:1788625261.363615:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185171968 00000100:00100000:0.0:1788625261.363809:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 49 00000100:00100000:0.0:1788625261.363819:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+68:12384:x1875509185171968:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788625261.364360:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+69:12384:x1875509185171968:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 539us (917us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788625261.364370:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 49 00000100:00100000:0.0:1788625261.368831:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625261.368930:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185172224 00000100:00100000:3.0:1788625261.368939:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185172224 00000100:00100000:3.0:1788625261.369005:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 195 00000100:00100000:3.0:1788625261.369015:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+69:12384:x1875509185172224:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788625261.369174:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+69:12384:x1875509185172224:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 160us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625261.369183:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 195 00000100:00100000:2.0:1788625261.380558:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625261.380964:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185172352 00000100:00100000:0.0:1788625261.380973:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185172352 00000100:00100000:0.0:1788625261.381034:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 196 00000100:00100000:0.0:1788625261.381043:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+69:12384:x1875509185172352:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625261.381079:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625261.381100:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1400/0x2d2e3b3f34a7afd1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e33f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.381169:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7afd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.381184:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7afd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.381196:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7afd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625261.381252:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625261.381272:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7afd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.382447:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1400/0x2d2e3b3f34a7afd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e33f expref: 71 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.382479:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7afd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e33f expref: 70 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.382491:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9987410b7500) 00010000:00010000:0.0:1788625261.382494:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788625261.382498:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae0400, rc 0) 00000100:00100000:1.0:1788625261.384199:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+70:12384:x1875509185172352:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 3144us (3683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625261.384213:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 196 00000100:00100000:2.0:1788625261.392093:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625261.392268:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185172480 00000100:00100000:0.0:1788625261.392280:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185172480 00000100:00100000:0.0:1788625261.392341:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 59 00000100:00100000:0.0:1788625261.392352:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2394:x1875509185172480:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625261.392382:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625261.392406:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c799f53/0x2d2e3b3f34a7afdf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e346 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625261.392432:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c416c, blocks: 0x0 00010000:00010000:0.0:1788625261.392452:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1788625261.392456:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625261.392466:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c799f53/0x2d2e3b3f34a7afdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e346 expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.392486:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c799f53/0x2d2e3b3f34a7afdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e346 expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.392499:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae1400, rc 0) 00000100:00100000:0.0:1788625261.392618:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2394:x1875509185172480:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 268us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625261.392625:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 59 00000100:00100000:1.0:1788625261.398149:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625261.398284:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185172736 00000100:00100000:2.0:1788625261.398305:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185172736 00000100:00100000:2.0:1788625261.398413:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 197 00000100:00100000:2.0:1788625261.398425:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+70:12384:x1875509185172736:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788625261.398589:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+70:12384:x1875509185172736:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 166us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625261.398598:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 197 00000100:00100000:2.0:1788625261.402026:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.402126:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185172864 00000100:00100000:1.0:1788625261.402139:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185172864 00000100:00100000:1.0:1788625261.402206:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 60 00000100:00100000:1.0:1788625261.402216:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:12384:x1875509185172864:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625261.402247:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625261.402269:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee00a674/0x2d2e3b3f34a7afe6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e34d expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.402340:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c799f53/0x2d2e3b3f34a7afdf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e346 expref: 9 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.402350:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625261.402354:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625261.402359:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee00a674/0x2d2e3b3f34a7afe6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e34d expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.402393:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c799f53/0x2d2e3b3f34a7afdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e346 expref: 9 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.402407:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c799f53/0x2d2e3b3f34a7afdf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e346 expref: 9 pid: 8424 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625261.402421:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8425:1875509206201216:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625261.402578:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861540 going to sleep for 11 seconds 00000100:00100000:0.0:1788625261.406366:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625261.406476:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185172992 00000100:00100000:2.0:1788625261.406486:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185172992 00010000:00010000:2.0:1788625261.406570:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c799f53/0x2d2e3b3f34a7afdf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e346 expref: 10 pid: 8424 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625261.406609:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 89 00000100:00100000:2.0:1788625261.406635:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:2394:x1875509185172992:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625261.406653:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625261.406678:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c799f53/0x2d2e3b3f34a7afdf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e346 expref: 10 pid: 8424 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.406693:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c799f53/0x2d2e3b3f34a7afdf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e346 expref: 10 pid: 8424 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.406720:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625261.406725:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625261.406733:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee00a674/0x2d2e3b3f34a7afe6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e34d expref: 10 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.406744:0:9513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee00a674/0x2d2e3b3f34a7afe6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e34d expref: 10 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.406781:0:9513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee00a674/0x2d2e3b3f34a7afe6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e34d expref: 10 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625261.406797:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441f9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9513:1875509206201344:192.168.204.14@tcp:105: 00000100:00100000:2.0:1788625261.406884:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bc780 going to sleep for 11 seconds 00010000:00010000:1.0:1788625261.407300:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c799f53/0x2d2e3b3f34a7afdf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e346 expref: 10 pid: 8424 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625261.407317:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8425:1875509206201216:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625261.407345:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee00a674/0x2d2e3b3f34a7afe6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e34d expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.407356:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4400, rc 0) 00000100:00100000:1.0:1788625261.407410:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:12384:x1875509185172864:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 5195us (5393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625261.407418:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 60 00000100:00100000:2.0:1788625261.410070:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441f9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9513:1875509206201344:192.168.204.14@tcp:105: 00010000:00010000:2.0:1788625261.410097:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625261.410148:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2394:x1875509185172992:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 3514us (3791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625261.410173:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 89 00000100:00100000:2.0:1788625261.415770:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.415884:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185173120 00000100:00100000:1.0:1788625261.415894:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185173120 00002000:00100000:1.0:1788625261.415954:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9987441fad80 x1875509185173120/t0(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:72/0 lens 504/0 e 0 to 0 dl 1788625272 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625261.415966:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9987441fad80 with x1875509185173120 ext(0->8) 00002000:00010000:1.0:1788625261.415972:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9987441fad80 00000100:00100000:1.0:1788625261.416051:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 4 00000100:00100000:1.0:1788625261.416063:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2394:x1875509185173120:12345-192.168.204.14@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788625261.418706:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:2394:x1875509185173120:12345-192.168.204.14@tcp:4:lhsmtool_posix.0 Request processed in 2634us (2933us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788625261.418721:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 4 00002000:00100000:1.0:1788625261.418735:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9987441fad80 x1875509185173120/t4294967315(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:72/0 lens 504/448 e 0 to 0 dl 1788625272 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625261.418745:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9987441fad80 with x1875509185173120 ext(0->8) 00002000:00010000:1.0:1788625261.418752:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9987441fad80 00000100:00100000:3.0:1788625261.424495:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.424781:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185173248 00000100:00100000:1.0:1788625261.424792:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185173248 00000100:00100000:1.0:1788625261.424863:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 198 00000100:00100000:1.0:1788625261.424873:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+70:12384:x1875509185173248:12345-192.168.204.14@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788625261.427372:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1788625261.427387:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00010000:00010000:0.0:1788625261.427536:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7ad0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427550:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7ad0e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427559:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7ad0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427565:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625261.427581:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7ad0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427590:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7ad0e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427606:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9988749c9a00) 00010000:00010000:0.0:1788625261.427610:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625261.427616:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7ad0e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427622:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994c00/0x2d2e3b3f34a7ad0e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427645:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7ad15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427651:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7ad15 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427657:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7ad15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427662:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c994600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625261.427665:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7ad15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427671:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7ad15 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427679:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:0.0:1788625261.427682:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625261.427692:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7ad15 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427698:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994600/0x2d2e3b3f34a7ad15 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427715:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7ad54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427720:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7ad54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427725:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7ad54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427730:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625261.427733:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7ad54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427739:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7ad54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427746:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988749c9300) 00010000:00010000:0.0:1788625261.427748:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625261.427751:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7ad54 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427757:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882170800/0x2d2e3b3f34a7ad54 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427773:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7ae57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427790:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7ae57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427797:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7ae57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427802:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625261.427806:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7ae57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427813:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7ae57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427821:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625261.427824:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625261.427827:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7ae57 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427833:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7ae57 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427844:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7ae7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427850:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7ae7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427856:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7ae7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427862:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625261.427870:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7ae7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427878:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7ae7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427886:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625261.427889:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625261.427892:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7ae7a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427899:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7ae7a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427909:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7aec0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427925:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7aec0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427930:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7aec0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427935:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625261.427937:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7aec0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427943:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7aec0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427950:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625261.427953:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625261.427962:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7aec0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427968:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7aec0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427981:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7afc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427986:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7afc3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427992:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7afc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.427997:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625261.428001:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7afc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.428007:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7afc3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.428015:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9987410b7500) 00010000:00010000:0.0:1788625261.428017:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788625261.428020:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7afc3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.428025:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7afc3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625261.428255:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206201472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788625261.428336:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625261.428452:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206201472 00000100:00100000:2.0:1788625261.428460:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206201472 00000100:00100000:2.0:1788625261.428538:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788625261.428548:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206201472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788625261.428679:0:8868:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788625261.428683:0:8868:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788625260 00002000:00010000:2.0:1788625261.428686:0:8868:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788625261.428688:0:8868:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788625260 -> 1788625260 00002000:00010000:2.0:1788625261.428690:0:8868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00080000:3.0:1788625261.428884:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788625261.429092:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788625261.429120:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9988512d20c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788625261.429124:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9988472fd500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9988512d23c0 00000020:00080000:1.0:1788625261.429128:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998866faea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff998742d39200 00000020:00080000:1.0:1788625261.429179:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788625261.429237:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788625261.429349:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:12384:x1875509185173248:12345-192.168.204.14@tcp:44:lhsmtool_posix.0 Request processed in 4475us (4919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625261.429359:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 198 00000100:00100000:3.0:1788625261.429662:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744051f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206201600:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788625261.429705:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625261.429754:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206201600 00000100:00100000:3.0:1788625261.429760:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206201600 00000100:00100000:3.0:1788625261.429796:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788625261.429803:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875509206201600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788625261.429821:0:8423:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:3.0:1788625261.429847:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c4169, atime: 0x6a9c4169, ctime: 0x6a9c4169, blocks: 0x8 00010000:00010000:3.0:1788625261.429854:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000568532f6/0x2d2e3b3f34a7afed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.429870:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=382s v=(0 0) 00010000:00010000:3.0:1788625261.429874:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625261.429881:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000568532f6/0x2d2e3b3f34a7afed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.429896:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000568532f6/0x2d2e3b3f34a7afed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.429907:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000568532f6/0x2d2e3b3f34a7afed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.429938:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000568532f6/0x2d2e3b3f34a7afed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.429954:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788625261.430064:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3636:x1875509206201600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 261us (359us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788625261.430071:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:3.0:1788625261.430091:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625261.430097:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000568532f6/0x2d2e3b3f34a7afed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.430105:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625261.430109:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000568532f6/0x2d2e3b3f34a7afed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.430118:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000568532f6/0x2d2e3b3f34a7afed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.430134:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000568532f6/0x2d2e3b3f34a7afed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.430142:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000568532f6/0x2d2e3b3f34a7afed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.430160:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625261.430168:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625261.430170:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788625261.430178:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788625261.430211:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff998744051f80/2, rc 0, transno 4294967308 00000100:00100000:3.0:1788625261.430217:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744051f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206201600:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788625261.431179:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206201472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2626us (2835us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788625261.431189:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:0.0:1788625261.432042:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff998744278a80/2, rc 0, transno 4294967316 00000100:00100000:0.0:1788625261.432052:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206201472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788625261.437383:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.437465:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185173376 00000100:00100000:1.0:1788625261.437478:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185173376 00000100:00100000:1.0:1788625261.437570:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 63 00000100:00100000:1.0:1788625261.437581:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:2393:x1875509185173376:12345-192.168.204.14@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788625261.439393:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1788625261.439405:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1788625261.439573:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185173376:12345-192.168.204.14@tcp:16:lhsmtool_posix.0 Request processed in 1990us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625261.439584:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 63 00000100:00100000:3.0:1788625261.442458:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.442583:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185173632 00000100:00100000:1.0:1788625261.442594:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185173632 00000100:00100000:1.0:1788625261.442657:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 199 00000100:00100000:1.0:1788625261.442666:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:12384:x1875509185173632:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788625261.442745:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625261.442774:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7afd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e33f expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.442795:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9987410b7500) 00010000:00010000:1.0:1788625261.442800:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625261.442837:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aff4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.442851:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aff4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.442861:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aff4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625261.443001:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e9e3c3e reply state 0000000050d0092c transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aff4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.443014:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aff4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.443021:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9987410b7500) 00010000:00010000:1.0:1788625261.443024:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788625261.443026:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625261.443137:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+20:12384:x1875509185173632:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 470us (688us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1788625261.443144:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 199 00000100:00100000:2.0:1788625261.446651:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625261.446787:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185173760 00000100:00100000:3.0:1788625261.446797:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185173760 00000100:00100000:3.0:1788625261.446858:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:3.0:1788625261.446869:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185173760:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788625261.447112:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788625261.447116:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788625260 -> 1788625259 00002000:00010000:3.0:1788625261.447119:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788625257 00002000:00010000:3.0:1788625261.447121:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788625260 -> 1788625259 00002000:00010000:3.0:1788625261.447124:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788625261.447302:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2393:x1875509185173760:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 Request processed in 433us (660us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788625261.447311:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:0.0:1788625261.451268:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625261.451513:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185174016 00000100:00100000:2.0:1788625261.452007:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185174016 00000100:00100000:2.0:1788625261.452125:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 200 00000100:00100000:2.0:1788625261.452137:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+20:12384:x1875509185174016:12345-192.168.204.14@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788625261.452219:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7affb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.452249:0:9824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7afbc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e331 expref: 20 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.452282:0:9824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7affb lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.452445:0:9824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7afbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e331 expref: 20 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.452460:0:9824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7afbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e331 expref: 20 pid: 9824 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625261.452475:0:9824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9824:1875509206201728:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625261.452607:0:9824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bc240 going to sleep for 11 seconds 00000100:00100000:0.0:1788625261.456469:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.456838:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185174144 00000100:00100000:1.0:1788625261.456847:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185174144 00010000:00010000:1.0:1788625261.456891:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7afbc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e331 expref: 21 pid: 9824 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625261.456952:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 90 00000100:00100000:1.0:1788625261.456964:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:2394:x1875509185174144:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625261.456981:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625261.456988:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7afbc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e331 expref: 21 pid: 9824 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.457017:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7afbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e331 expref: 21 pid: 9824 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.457041:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9987410b7500) 00010000:00010000:1.0:1788625261.457046:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7affb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.457056:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7affb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.457064:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7affb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.457085:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625261.457144:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:2394:x1875509185174144:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 182us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625261.457152:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 90 00010000:00010000:2.0:1788625261.457893:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7afbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e331 expref: 20 pid: 9824 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625261.457919:0:9824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9824:1875509206201728:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625261.457942:0:9824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7affb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.457952:0:9824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7affb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.457958:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7affb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.457995:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7affb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.458003:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7affb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.458018:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7affb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.458025:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625261.458029:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7affb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.458037:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7affb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.458047:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9987410b7500) 00010000:00010000:2.0:1788625261.458050:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788625261.458054:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7affb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.458061:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188200/0x2d2e3b3f34a7affb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625261.458116:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:12384:x1875509185174016:12345-192.168.204.14@tcp:55:lhsmtool_posix.0 Request processed in 5981us (6857us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788625261.458124:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 200 00000100:00100000:0.0:1788625261.463908:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625261.464007:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185174272 00000100:00100000:3.0:1788625261.464018:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185174272 00000100:00100000:3.0:1788625261.464073:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:3.0:1788625261.464083:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2394:x1875509185174272:12345-192.168.204.14@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788625261.464134:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7b002 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.464156:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee00a674/0x2d2e3b3f34a7afe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e34d expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.464185:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625261.464190:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625261.464194:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7b002 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.464245:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee00a674/0x2d2e3b3f34a7afe6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e34d expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.464262:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee00a674/0x2d2e3b3f34a7afe6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e34d expref: 8 pid: 8425 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625261.464278:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742e40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1875509206201856:192.168.204.14@tcp:104: 00000100:00100000:3.0:1788625261.464376:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887cabed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625261.468131:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625261.468254:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742e40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1875509206201856:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625261.468283:0:8423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7b002 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625261.468595:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185174400 00000100:00100000:1.0:1788625261.468603:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185174400 00010000:00010000:1.0:1788625261.468646:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee00a674/0x2d2e3b3f34a7afe6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e34d expref: 9 pid: 8425 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625261.468688:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 91 00000100:00100000:1.0:1788625261.468699:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:2393:x1875509185174400:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625261.468716:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625261.468738:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee00a674/0x2d2e3b3f34a7afe6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e34d expref: 9 pid: 8425 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.468775:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee00a674/0x2d2e3b3f34a7afe6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e34d expref: 9 pid: 8425 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.468799:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee00a674/0x2d2e3b3f34a7afe6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e34d expref: 9 pid: 8425 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.468818:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788625261.468823:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788625261.468830:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7b002 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.468841:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7b002 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.468876:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625261.469446:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2393:x1875509185174400:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 747us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625261.469455:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 91 00010000:00010000:3.0:1788625261.469609:0:8423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7b002 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.469620:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7b002 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.469642:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7b002 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.469658:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7b002 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.469666:0:8423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7b002 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.469673:0:8423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625261.469677:0:8423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7b002 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.469687:0:8423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7b002 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.469700:0:8423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7b002 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.469708:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9954189/0x2d2e3b3f34a7b002 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625261.469760:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2394:x1875509185174272:12345-192.168.204.14@tcp:1:lhsmtool_posix.0 Request processed in 5678us (5862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625261.469769:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:0.0:1788625261.472689:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.472762:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185174656 00000100:00100000:1.0:1788625261.472771:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185174656 00000100:00100000:1.0:1788625261.472831:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 201 00000100:00100000:1.0:1788625261.472841:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:12384:x1875509185174656:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788625261.472946:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b009 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.472968:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ae50 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2d6 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.472991:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b009 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.473034:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ae50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2d6 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.473049:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ae50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2d6 expref: 19 pid: 6512 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625261.473063:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206201984:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625261.473150:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438610c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625261.477035:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625261.477119:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185174784 00000100:00100000:2.0:1788625261.477129:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185174784 00010000:00010000:2.0:1788625261.477170:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ae50 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2d6 expref: 20 pid: 6512 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625261.477214:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 92 00000100:00100000:2.0:1788625261.477234:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744287100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+20:2394:x1875509185174784:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625261.477249:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625261.477270:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ae50 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2d6 expref: 20 pid: 6512 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.477284:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ae50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2d6 expref: 20 pid: 6512 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.477315:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:2.0:1788625261.477320:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b009 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.477331:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b009 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.477339:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b009 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.477359:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625261.477415:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744287100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+20:2394:x1875509185174784:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 193us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625261.477422:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 92 00010000:00010000:1.0:1788625261.477840:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7ae50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e2d6 expref: 19 pid: 6512 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625261.477857:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206201984:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625261.477878:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b009 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.477887:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b009 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.477893:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b009 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.478055:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b010 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.478066:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7afca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e338 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.478082:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b010 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.478110:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7afca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e338 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.478122:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7afca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e338 expref: 19 pid: 6511 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625261.478136:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206202112:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625261.478195:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861180 going to sleep for 11 seconds 00000100:00100000:1.0:1788625261.481017:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206202112:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625261.481050:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b010 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625261.482195:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625261.482306:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185174912 00000100:00100000:2.0:1788625261.482314:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185174912 00010000:00010000:2.0:1788625261.482352:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7afca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e338 expref: 20 pid: 6511 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625261.482390:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 93 00000100:00100000:2.0:1788625261.482398:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+20:2394:x1875509185174912:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625261.482412:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625261.482420:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7afca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e338 expref: 20 pid: 6511 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.482439:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7afca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e338 expref: 20 pid: 6511 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.482461:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7afca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e338 expref: 20 pid: 6511 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.482476:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9987410b7500) 00010000:00010000:2.0:1788625261.482481:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b010 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.482490:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b010 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.482497:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b010 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625261.482575:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625261.482632:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:2394:x1875509185174912:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 233us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625261.482639:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 93 00010000:00010000:1.0:1788625261.482863:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b010 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.482872:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b010 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625261.482988:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1788625261.483100:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788625261.483137:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1788625261.483210:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1875509206202240:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788625261.483272:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625261.483343:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861900 going to sleep for 11 seconds 00000100:00100000:3.0:1788625261.484773:0:14517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206202240 00000100:00100000:3.0:1788625261.484784:0:14517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206202240 00000100:00100000:3.0:1788625261.484893:0:14517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788625261.484902:0:14517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1875509206202240:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788625261.485090:0:14517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1875509206202240:12345-0@lo:1000:mdt00_001.0 Request processed in 188us (1817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625261.485098:0:14517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788625261.485231:0:6512:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1788625261.485238:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff998744278a80, transno 4294967316 00000100:00100000:0.0:1788625261.485257:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1875509206202240:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788625261.485393:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1788625261.485455:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744284000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1875509206202368:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788625261.485489:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625261.485692:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206202368 00000100:00100000:1.0:1788625261.485697:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206202368 00000100:00100000:1.0:1788625261.485727:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788625261.485734:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1875509206202368:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788625261.485824:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6512:x1875509206202368:12345-0@lo:1000:mdt00_001.0 Request processed in 89us (334us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788625261.485831:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788625261.485881:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437989c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625261.485899:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744284000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1875509206202368:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788625261.486170:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b010 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486181:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b010 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486189:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b010 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486195:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625261.486200:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b010 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486219:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b010 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486246:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9987410b7500) 00010000:00010000:0.0:1788625261.486249:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625261.486254:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b010 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486261:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b010 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486465:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7af45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486473:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7af45 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486480:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7af45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486485:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625261.486488:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7af45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486494:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7af45 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486502:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625261.486505:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625261.486507:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7af45 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486684:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7af45 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486708:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b017 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486721:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e31c expref: 22 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486731:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b017 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486756:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e31c expref: 22 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.486770:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e31c expref: 22 pid: 9824 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625261.486782:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744284a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206202496:192.168.204.14@tcp:104: 00000100:00100000:0.0:1788625261.486878:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437989c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625261.490816:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744284a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206202496:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625261.490847:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b017 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625261.491356:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.491569:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185175040 00000100:00100000:1.0:1788625261.491578:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185175040 00010000:00010000:1.0:1788625261.491620:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e31c expref: 23 pid: 9824 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625261.491656:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 94 00000100:00100000:1.0:1788625261.491667:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+23:2393:x1875509185175040:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625261.491685:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625261.491693:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e31c expref: 23 pid: 9824 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.491707:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e31c expref: 23 pid: 9824 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.491730:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7af61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e31c expref: 23 pid: 9824 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.491747:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:1.0:1788625261.491752:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b017 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.491780:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b017 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.491787:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b017 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.491810:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625261.491866:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:2393:x1875509185175040:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 200us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625261.491874:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 94 00010000:00010000:0.0:1788625261.492009:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b017 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.492028:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b017 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.492040:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b017 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.492047:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b017 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.492055:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b017 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.492061:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625261.492065:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b017 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.492074:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b017 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.492084:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625261.492086:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625261.492090:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b017 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.492097:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b017 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.492109:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b009 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.492115:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b009 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.492128:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b009 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.492133:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625261.492136:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b009 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.492143:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b009 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.492151:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9987410b7800) 00010000:00010000:0.0:1788625261.492153:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788625261.492156:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b009 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625261.492161:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b009 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625261.492643:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:12384:x1875509185174656:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 19672us (19832us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788625261.492656:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 201 00000020:00080000:0.0:1788625261.492661:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788625261.492812:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788625261.492817:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625261.493863:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788625261.493878:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788625261.495668:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.496047:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185175296 00000100:00100000:1.0:1788625261.496059:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185175296 00000100:00100000:1.0:1788625261.496379:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 50 00000100:00100000:1.0:1788625261.496393:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866f56850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:12384:x1875509185175296:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788625261.496867:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788625261.496918:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1788625261.497190:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b01e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.497349:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b01e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.497364:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b01e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.497375:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b01e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.497381:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b01e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.497402:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b01e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625261.497426:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625261.497642:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625261.497650:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b01e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625261.497656:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866f56850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+23:12384:x1875509185175296:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 1263us (1995us total) trans 4294967470 rc 0/0 00010000:00010000:3.0:1788625261.497658:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625261.497663:0:10330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b01e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625261.497667:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 50 00010000:00010000:3.0:1788625261.497673:0:10330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b01e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788625261.497674:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788625261.497687:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9987410b7500) 00010000:00010000:3.0:1788625261.497690:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788625261.497695:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b01e lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.497701:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b01e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625261.497714:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625261.497716:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625261.497717:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625261.568345:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625261.568412:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.568552:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185175552 00000100:00100000:1.0:1788625261.568564:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185175552 00000100:00100000:1.0:1788625261.568637:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 313 00000100:00100000:1.0:1788625261.568648:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185175552:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625261.568719:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2391:x1875509185175552:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 73us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625261.568725:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 313 00000100:00080000:3.0:1788625261.569020:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625261.570781:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185175424 00000100:00100000:0.0:1788625261.570793:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185175424 00000100:00100000:0.0:1788625261.570861:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 387 00000100:00100000:0.0:1788625261.570870:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2391:x1875509185175424:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625261.570944:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2391:x1875509185175424:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 75us (2612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625261.570968:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 387 00000100:00100000:2.0:1788625261.571579:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625261.571693:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.571756:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185175808 00000100:00100000:1.0:1788625261.571763:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185175808 00000100:00100000:1.0:1788625261.571823:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 314 00000100:00100000:1.0:1788625261.571834:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2392:x1875509185175808:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625261.571837:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185175680 00000100:00100000:0.0:1788625261.571843:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185175680 00000100:00100000:0.0:1788625261.571882:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 125 00000100:00100000:1.0:1788625261.571890:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2392:x1875509185175808:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 58us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625261.571895:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2391:x1875509185175680:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625261.571904:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 314 00000100:00080000:1.0:1788625261.571925:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788625261.571930:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625261.571943:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2391:x1875509185175680:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 52us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625261.571951:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 125 00000100:00100000:2.0:1788625261.572066:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625261.572279:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185175936 00000100:00100000:1.0:1788625261.572284:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185175936 00000100:00100000:1.0:1788625261.572351:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 315 00000100:00100000:1.0:1788625261.572359:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185175936:12345-192.168.204.14@tcp:400:kworker.0 00000100:00080000:0.0:1788625261.572987:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788625261.572993:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2391:x1875509185175936:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 631us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625261.573003:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 315 00010000:00010000:1.0:1788625261.643964:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625261.772682:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788625262.667672:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625262.877691:0:14752:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788625262.877701:0:14752:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788625262.877725:0:14752:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788625262.877731:0:14752:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788625262.992978:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625262.993067:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185176192 00000100:00100000:3.0:1788625262.993076:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185176192 00000100:00100000:3.0:1788625262.993156:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 202 00000100:00100000:3.0:1788625262.993167:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+23:12401:x1875509185176192:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625262.993203:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625262.993226:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b025 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e354 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625262.993335:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7b02c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625262.993351:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7b02c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625262.993365:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7b02c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625262.993377:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788625262.993494:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b025 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e354 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625262.993553:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7b02c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e354 expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625262.993563:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:3.0:1788625262.993566:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788625262.993570:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682200, rc 0) 00000100:00100000:3.0:1788625262.993635:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+25:12401:x1875509185176192:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 470us (665us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788625262.993658:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 202 00000100:00080000:0.0:1788625262.993995:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625263.002411:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625263.002505:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185176320 00000100:00100000:2.0:1788625263.002551:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185176320 00000100:00100000:2.0:1788625263.002611:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 203 00000100:00100000:2.0:1788625263.002621:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+25:12401:x1875509185176320:12345-192.168.204.14@tcp:34:lfs.0 00010000:00010000:2.0:1788625263.002711:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b03a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.002732:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b03a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.002745:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b03a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.002799:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b041 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.002807:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.002814:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003079:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7b048 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003089:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7b048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003096:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7b048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625263.003145:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7b048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003171:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b03a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003178:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b03a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003185:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b03a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003201:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625263.003206:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b03a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003214:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b03a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003227:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:2.0:1788625263.003230:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625263.003234:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b03a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003241:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b03a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003253:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003259:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b041 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003264:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b041 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003275:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625263.003279:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b041 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003285:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b041 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003293:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988625be600) 00010000:00010000:2.0:1788625263.003295:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625263.003298:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b041 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003303:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b041 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003320:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7b048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003326:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7b048 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003332:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7b048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003337:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625263.003340:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7b048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003631:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7b048 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003652:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988625beb00) 00010000:00010000:2.0:1788625263.003655:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625263.003658:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7b048 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.003664:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189200/0x2d2e3b3f34a7b048 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625263.003754:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+25:12401:x1875509185176320:12345-192.168.204.14@tcp:34:lfs.0 Request processed in 1132us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625263.003763:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 203 00000100:00100000:3.0:1788625263.063468:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625263.063673:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185176576 00000100:00100000:0.0:1788625263.063685:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185176576 00000100:00100000:0.0:1788625263.063758:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 204 00000100:00100000:0.0:1788625263.063771:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+25:12404:x1875509185176576:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:0.0:1788625263.063801:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625263.063855:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b04f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e35b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.063951:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7b056 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.063970:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7b056 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.063986:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7b056 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064016:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b05d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064024:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b05d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064030:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b05d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064172:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b064 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064182:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b064 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064199:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b064 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625263.064210:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788625263.064301:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7b056 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064309:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7b056 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064316:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7b056 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064321:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625263.064326:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7b056 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064344:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7b056 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064356:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:0.0:1788625263.064360:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625263.064365:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7b056 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064372:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7b056 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064388:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b05d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064393:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b05d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064399:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b05d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064405:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625263.064408:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b05d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064415:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b05d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064422:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988749c3e00) 00010000:00010000:0.0:1788625263.064425:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625263.064428:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b05d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064443:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b05d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064487:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b04f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e35b expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064500:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b064 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e35b expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.064507:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:0.0:1788625263.064544:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625263.064548:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae0800, rc 0) 00000100:00100000:0.0:1788625263.064613:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+27:12404:x1875509185176576:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 845us (1160us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788625263.064620:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 204 00000100:00100000:0.0:1788625263.073157:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625263.073245:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185176704 00000100:00100000:1.0:1788625263.073257:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185176704 00000100:00100000:1.0:1788625263.073322:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 205 00000100:00100000:1.0:1788625263.073333:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+27:12404:x1875509185176704:12345-192.168.204.14@tcp:54:lfs.0 00010000:00010000:1.0:1788625263.073410:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b072 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.073429:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b072 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.073447:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b072 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.073487:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b072 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.073493:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b072 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.073543:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b072 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.073551:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625263.073556:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b072 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.073564:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b072 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.073579:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:1.0:1788625263.073583:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625263.073587:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b072 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.073595:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b072 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625263.073683:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+27:12404:x1875509185176704:12345-192.168.204.14@tcp:54:lfs.0 Request processed in 351us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625263.073691:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 205 00000100:00100000:2.0:1788625263.081031:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625263.081068:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185176960 00000100:00100000:2.0:1788625263.081079:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185176960 00000100:00100000:2.0:1788625263.081140:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 51 00000100:00100000:2.0:1788625263.081150:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+27:12404:x1875509185176960:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:2.0:1788625263.081388:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+28:12404:x1875509185176960:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 239us (367us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788625263.081397:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 51 00000100:00100000:3.0:1788625263.133389:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625263.133617:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185177216 00000100:00100000:0.0:1788625263.133640:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185177216 00000100:00100000:0.0:1788625263.133720:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 206 00000100:00100000:0.0:1788625263.133731:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+28:11928:x1875509185177216:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:0.0:1788625263.133758:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625263.133782:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b079 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e362 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.134200:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.134233:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b064 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e35b expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.134243:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.134278:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b064 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e35b expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.134293:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b064 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e35b expref: 29 pid: 6512 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625263.134307:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744286300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875509206202624:192.168.204.14@tcp:104: 00000100:00100000:0.0:1788625263.134578:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743798540 going to sleep for 11 seconds 00000100:00100000:1.0:1788625263.142647:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625263.142734:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185177344 00000100:00100000:2.0:1788625263.142746:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185177344 00010000:00010000:2.0:1788625263.142795:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b064 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e35b expref: 30 pid: 6512 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625263.142841:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 95 00000100:00100000:2.0:1788625263.142853:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+30:2393:x1875509185177344:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625263.142868:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625263.142891:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b064 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e35b expref: 30 pid: 6512 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.142906:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b064 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e35b expref: 30 pid: 6512 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.142934:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:2.0:1788625263.142939:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.142950:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.142957:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.142976:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625263.142984:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b064 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e35b expref: 30 pid: 6512 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625263.143000:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744286300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875509206202624:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625263.143020:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625263.143026:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+29:2393:x1875509185177344:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 176us (390us total) trans 0 rc 0/0 00010000:00010000:0.0:1788625263.143029:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625263.143034:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 95 00010000:00010000:0.0:1788625263.143035:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625263.143053:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788625263.145985:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b079 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e362 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.146012:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e362 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.146022:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:0.0:1788625263.146025:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788625263.146029:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae0400, rc 0) 00000100:00100000:0.0:1788625263.146962:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+29:11928:x1875509185177216:12345-192.168.204.14@tcp:101:bash.0 Request processed in 12595us (12946us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1788625263.146973:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 206 00000100:00100000:1.0:1788625263.151633:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625263.151803:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185177472 00000100:00100000:0.0:1788625263.151816:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185177472 00000100:00100000:0.0:1788625263.151893:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 207 00000100:00100000:0.0:1788625263.151905:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+29:11928:x1875509185177472:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:0.0:1788625263.151932:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625263.151952:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b08e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e369 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.151993:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7b095 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.152009:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7b095 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.152022:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7b095 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.152167:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b08e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e369 expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.152198:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7b095 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e369 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.152209:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:0.0:1788625263.152212:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788625263.152216:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae1c00, rc 0) 00000100:00100000:0.0:1788625263.152287:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+30:11928:x1875509185177472:12345-192.168.204.14@tcp:101:bash.0 Request processed in 383us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625263.152296:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 207 00000100:00100000:2.0:1788625263.154993:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625263.155565:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185177728 00000100:00100000:1.0:1788625263.155577:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185177728 00000100:00100000:1.0:1788625263.155651:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 208 00000100:00100000:1.0:1788625263.155663:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+30:11928:x1875509185177728:12345-192.168.204.14@tcp:36:bash.0 00010000:00010000:1.0:1788625263.158475:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b09c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.158536:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.158548:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625263.158613:0:9824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1788625263.158643:0:9824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bf5dc6f reply state 000000003c43be91 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.158655:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b09c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.158663:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:1.0:1788625263.158666:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788625263.158670:0:9824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788625263.158712:0:9824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1788625263.162373:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+34:11928:x1875509185177728:12345-192.168.204.14@tcp:36:bash.0 Request processed in 6699us (7377us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788625263.162386:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 208 00000020:00080000:1.0:1788625263.162393:0:9824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788625263.172719:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625263.172939:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185177856 00000100:00100000:0.0:1788625263.172951:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185177856 00000100:00100000:0.0:1788625263.173029:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 209 00000100:00100000:0.0:1788625263.173039:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+34:11928:x1875509185177856:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:0.0:1788625263.173066:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625263.173090:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b0a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e370 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.173154:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b0a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e370 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.173171:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b0a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e370 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.173224:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:0.0:1788625263.173227:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625263.173232:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae0800, rc 0) 00000100:00100000:2.0:1788625263.175389:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+35:11928:x1875509185177856:12345-192.168.204.14@tcp:101:bash.0 Request processed in 2341us (2670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625263.175401:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 209 00000100:00100000:0.0:1788625263.186947:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625263.187165:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185177984 00000100:00100000:1.0:1788625263.187177:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185177984 00000100:00100000:1.0:1788625263.187284:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 66 00000100:00100000:1.0:1788625263.187297:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:11928:x1875509185177984:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:1.0:1788625263.187317:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625263.187339:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9e57d5c/0x2d2e3b3f34a7b0aa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e377 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625263.187385:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c416b, atime: 0x6a9c4169, ctime: 0x6a9c416b, blocks: 0x8 00010000:00010000:1.0:1788625263.187411:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1788625263.187416:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625263.187426:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e57d5c/0x2d2e3b3f34a7b0aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e377 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.187447:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9e57d5c/0x2d2e3b3f34a7b0aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e377 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.187462:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4000, rc 0) 00000100:00100000:1.0:1788625263.187568:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:11928:x1875509185177984:12345-192.168.204.14@tcp:101:bash.0 Request processed in 274us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625263.187576:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 66 00000100:00080000:0.0:1788625263.187737:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625263.191770:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625263.191885:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185178112 00000100:00100000:0.0:1788625263.191896:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185178112 00002000:00010000:0.0:1788625263.192008:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788625263.192014:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998744229c00 with x1875509185178112 ext(0->18446744073709551615) 00002000:00010000:0.0:1788625263.192026:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff998744229c00. 00000100:00100000:0.0:1788625263.192102:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 5 00000100:00100000:0.0:1788625263.192114:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2392:x1875509185178112:12345-192.168.204.14@tcp:10:bash.0 00002000:00010000:0.0:1788625263.192510:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788625263.192538:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788625259 -> 1788625262 00002000:00010000:0.0:1788625263.192542:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788625257 -> 1788625257 00002000:00010000:0.0:1788625263.192544:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788625259 -> 1788625262 00002000:00010000:0.0:1788625263.192546:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788625263.192620:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:2392:x1875509185178112:12345-192.168.204.14@tcp:10:bash.0 Request processed in 501us (852us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788625263.192629:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 5 00002000:00010000:0.0:1788625263.192632:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788625263.192635:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998744229c00 with x1875509185178112 ext(0->18446744073709551615) 00002000:00010000:0.0:1788625263.192639:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff998744229c00. 00000100:00100000:2.0:1788625263.269391:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625263.274135:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185178240 00000100:00100000:1.0:1788625263.274153:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185178240 00000100:00100000:1.0:1788625263.274432:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 210 00000100:00100000:1.0:1788625263.274444:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+35:12418:x1875509185178240:12345-192.168.204.14@tcp:34:lfs.0 00010000:00010000:1.0:1788625263.274562:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0b1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274582:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274595:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274634:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7b0b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274642:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7b0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274648:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7b0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274726:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b0bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274735:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b0bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274742:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b0bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625263.274786:0:11318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b0bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274797:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274804:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0b1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274810:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274816:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625263.274820:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274834:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0b1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274847:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:1.0:1788625263.274850:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625263.274856:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274863:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274877:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7b0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274883:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7b0b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274889:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7b0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274894:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625263.274896:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7b0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274902:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7b0b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274908:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9987410b7f00) 00010000:00010000:1.0:1788625263.274911:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625263.274914:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7b0b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274929:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7b0b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274945:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b0bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274951:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b0bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274957:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b0bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274962:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625263.274965:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b0bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274971:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b0bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274979:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:1.0:1788625263.274982:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625263.274985:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b0bf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.274991:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b0bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625263.275114:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+35:12418:x1875509185178240:12345-192.168.204.14@tcp:34:lfs.0 Request processed in 671us (5732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625263.275122:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 210 00000100:00100000:1.0:1788625263.330697:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625263.330821:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185178496 00000100:00100000:3.0:1788625263.330831:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185178496 00000100:00100000:3.0:1788625263.330900:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 211 00000100:00100000:3.0:1788625263.330911:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+35:12421:x1875509185178496:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625263.330932:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625263.330957:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b0c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e37e expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331038:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b0cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331053:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b0cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331065:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b0cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331079:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b0d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331087:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331093:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331237:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b0db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331513:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b0db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331614:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b0db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625263.331626:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788625263.331708:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b0cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331717:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b0cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331724:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b0cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331730:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625263.331735:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b0cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331743:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b0cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331755:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:3.0:1788625263.331758:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625263.331763:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b0cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331781:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b0cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331797:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331803:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b0d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331809:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331814:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625263.331817:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331824:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b0d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331832:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988606b3e00) 00010000:00010000:3.0:1788625263.331835:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625263.331837:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b0d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.331843:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b0d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.335392:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b0c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e37e expref: 38 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.335426:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b0db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e37e expref: 37 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.335455:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:3.0:1788625263.335458:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788625263.335461:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683c00, rc 0) 00000100:00100000:3.0:1788625263.335558:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+37:12421:x1875509185178496:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 4647us (4868us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788625263.335567:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 211 00000100:00100000:2.0:1788625263.340656:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625263.340892:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185178624 00000100:00100000:0.0:1788625263.340902:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185178624 00000100:00100000:0.0:1788625263.340975:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 212 00000100:00100000:0.0:1788625263.340987:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+37:12421:x1875509185178624:12345-192.168.204.14@tcp:54:lfs.0 00010000:00010000:0.0:1788625263.341059:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b0e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.341077:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e362 expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.341088:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b0e9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.341125:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e362 expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.341139:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e362 expref: 37 pid: 6513 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625263.341154:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744284380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875509206202752:192.168.204.14@tcp:104: 00000100:00100000:0.0:1788625263.341978:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743798540 going to sleep for 11 seconds 00000100:00100000:2.0:1788625263.346013:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625263.346238:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185178880 00000100:00100000:1.0:1788625263.346259:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185178880 00000100:00100000:0.0:1788625263.346401:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744284380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1875509206202752:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625263.346429:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b0e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625263.346818:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 52 00000100:00100000:1.0:1788625263.346831:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+38:6161:x1875509185178880:12345-192.168.204.14@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788625263.347142:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+39:6161:x1875509185178880:12345-192.168.204.14@tcp:35:ldlm_bl.0 Request processed in 313us (1138us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788625263.347150:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 52 00000100:00100000:0.0:1788625263.350636:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625263.353374:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185179008 00000100:00100000:2.0:1788625263.353403:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185179008 00010000:00010000:2.0:1788625263.353452:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e362 expref: 39 pid: 6513 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625263.353583:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 96 00000100:00100000:2.0:1788625263.353594:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+39:2394:x1875509185179008:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625263.353610:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625263.353617:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e362 expref: 39 pid: 6513 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.353631:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e362 expref: 39 pid: 6513 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.353652:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b080 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e362 expref: 39 pid: 6513 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.353669:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:2.0:1788625263.353674:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b0e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.353685:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.353693:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b0e9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.353727:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625263.353790:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+38:2394:x1875509185179008:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 197us (3164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625263.353808:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 96 00010000:00010000:0.0:1788625263.353911:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.353920:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.353972:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.353979:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b0e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.353985:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.353990:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625263.353994:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.354002:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b0e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.354012:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:0.0:1788625263.354015:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788625263.354019:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b0e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.354025:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b0e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625263.354066:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+37:12421:x1875509185178624:12345-192.168.204.14@tcp:54:lfs.0 Request processed in 13081us (13421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625263.354073:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 212 00000100:00100000:3.0:1788625263.357335:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625263.357481:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185179264 00000100:00100000:0.0:1788625263.357493:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185179264 00000100:00100000:0.0:1788625263.357588:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 53 00000100:00100000:0.0:1788625263.357613:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+37:12421:x1875509185179264:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:0.0:1788625263.357887:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+38:12421:x1875509185179264:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 263us (550us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788625263.357897:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 53 00000100:00100000:3.0:1788625263.374574:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206202880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788625263.374720:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625263.375696:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206202880 00000100:00100000:2.0:1788625263.375707:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206202880 00000100:00100000:2.0:1788625263.376495:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788625263.376509:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206202880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788625263.376583:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788625263.377628:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206202880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1120us (2904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625263.377638:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788625263.378805:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206202880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788625263.481019:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625263.481168:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185179520 00000100:00100000:1.0:1788625263.481190:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185179520 00000100:00100000:1.0:1788625263.481266:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 213 00000100:00100000:1.0:1788625263.481276:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+38:12432:x1875509185179520:12345-192.168.204.14@tcp:101:cat.0 00010000:00010000:1.0:1788625263.481305:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625263.481330:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7b0f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e385 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.481408:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.481424:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.481435:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.481448:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b0fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.481454:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b0fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.481477:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b0fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.482196:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b105 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.482210:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.482217:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625263.482228:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788625263.483852:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.483869:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0f7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.483875:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.483881:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625263.483886:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.483893:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.483908:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:1.0:1788625263.483911:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625263.483932:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.483940:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b0f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.483956:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b0fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.483962:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b0fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.483967:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b0fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.483972:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625263.483974:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b0fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.483979:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b0fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.483987:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9987410b7f00) 00010000:00010000:1.0:1788625263.483989:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625263.483991:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b0fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.483997:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b0fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.484052:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5600/0x2d2e3b3f34a7b0f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e385 expref: 41 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.486237:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e385 expref: 40 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.486248:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:1.0:1788625263.487325:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625263.487331:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4200, rc 0) 00000100:00100000:1.0:1788625263.487419:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+40:12432:x1875509185179520:12345-192.168.204.14@tcp:101:cat.0 Request processed in 6140us (6406us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788625263.487429:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 213 00000100:00100000:0.0:1788625263.494572:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625263.495319:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185179776 00000100:00100000:1.0:1788625263.495332:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185179776 00000100:00100000:1.0:1788625263.495387:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 54 00000100:00100000:1.0:1788625263.495398:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+40:12432:x1875509185179776:12345-192.168.204.14@tcp:35:cat.0 00000100:00100000:0.0:1788625263.495823:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+41:12432:x1875509185179776:12345-192.168.204.14@tcp:35:cat.0 Request processed in 425us (1309us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788625263.495832:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 54 00000100:00100000:3.0:1788625263.527141:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625263.527240:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185180032 00000100:00100000:1.0:1788625263.527259:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185180032 00000100:00100000:1.0:1788625263.527325:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 214 00000100:00100000:1.0:1788625263.527336:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+41:12433:x1875509185180032:12345-192.168.204.14@tcp:36:rm.0 00010000:00010000:1.0:1788625263.527396:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788625263.527424:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0800/0x2d2e3b3f34a7b0a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e370 expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.527451:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7b105 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e385 expref: 40 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.527463:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b0db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e37e expref: 39 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.527494:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1c00/0x2d2e3b3f34a7b095 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e369 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.527504:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:1.0:1788625263.527509:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625263.527664:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b113 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.527681:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b113 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.527690:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b113 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.527707:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b11a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.527713:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b11a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.527720:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b11a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.527804:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b121 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.527813:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b121 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.527820:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b121 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625263.528030:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788625263.528041:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384635522712ns, next at 385635520250ns, rc = 0 00010000:00010000:3.0:1788625263.528088:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b128 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528098:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b128 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528105:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b128 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528112:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b128 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528118:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b128 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528124:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b128 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528149:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625263.528170:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b121 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528193:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b121 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528199:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b121 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528205:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625263.528209:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b121 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528217:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b121 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528227:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:3.0:1788625263.528230:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788625263.528234:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b121 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528240:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b121 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.528427:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625263.528434:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b128 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.528441:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683600 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625263.528444:0:10330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b128 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.528450:0:10330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b128 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.528460:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:0.0:1788625263.528462:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788625263.528465:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b128 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.528470:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b128 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.528482:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625263.528491:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625263.528492:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625263.528711:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b113 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528719:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b113 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528725:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b113 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528730:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625263.528739:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b113 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528746:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b113 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528755:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:3.0:1788625263.528757:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625263.528761:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b113 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528766:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b113 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788625263.528776:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000706deb78 reply state 00000000103fa810 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b11a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528787:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b11a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.528793:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988606b3e00) 00010000:00010000:3.0:1788625263.528795:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788625263.528798:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788625263.529434:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+39:12433:x1875509185180032:12345-192.168.204.14@tcp:36:rm.0 Request processed in 2095us (2298us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788625263.529444:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 214 00000100:00100000:3.0:1788625263.577996:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625263.578145:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185180288 00000100:00100000:0.0:1788625263.578159:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185180288 00000100:00100000:0.0:1788625263.578242:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 215 00000100:00100000:0.0:1788625263.578254:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+39:12439:x1875509185180288:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:0.0:1788625263.578280:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625263.578314:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7b12f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e38c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.578432:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0600/0x2d2e3b3f34a7b136 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.578449:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0600/0x2d2e3b3f34a7b136 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.578461:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0600/0x2d2e3b3f34a7b136 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.578472:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0000/0x2d2e3b3f34a7b13d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.578480:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0000/0x2d2e3b3f34a7b13d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.578487:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0000/0x2d2e3b3f34a7b13d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788625263.579417:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788625263.579618:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b144 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.579652:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.579944:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.579984:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0600/0x2d2e3b3f34a7b136 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.579992:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0600/0x2d2e3b3f34a7b136 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.579999:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0600/0x2d2e3b3f34a7b136 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.580005:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625263.580010:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0600/0x2d2e3b3f34a7b136 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.580019:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0600/0x2d2e3b3f34a7b136 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.580032:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:0.0:1788625263.580035:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625263.580040:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0600/0x2d2e3b3f34a7b136 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.580048:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0600/0x2d2e3b3f34a7b136 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625263.580063:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bd570ad reply state 00000000e3c1f761 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0000/0x2d2e3b3f34a7b13d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.580082:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0000/0x2d2e3b3f34a7b13d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.580089:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988606b3e00) 00010000:00010000:0.0:1788625263.580091:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788625263.580094:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788625263.580131:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1800/0x2d2e3b3f34a7b12f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e38c expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.580147:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b144 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e38c expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.580154:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:0.0:1788625263.580157:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625263.580158:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae1a00, rc 0) 00000100:00100000:0.0:1788625263.580255:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:12439:x1875509185180288:12345-192.168.204.14@tcp:101:bash.0 Request processed in 2003us (2269us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788625263.580264:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 215 00000100:00100000:0.0:1788625263.584787:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625263.584979:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185180416 00000100:00100000:2.0:1788625263.584990:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185180416 00000100:00100000:2.0:1788625263.585067:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 67 00000100:00100000:2.0:1788625263.585078:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185180416:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625263.585098:0:8868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625263.585123:0:8868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7b152 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e393 expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625263.585153:0:8868:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625263.585173:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788625263.585190:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625263.585201:0:8868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7b152 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e393 expref: 8 pid: 8868 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.585222:0:8868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7b152 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e393 expref: 8 pid: 8868 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.585438:0:8868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188c00, rc 0) 00000100:00100000:2.0:1788625263.585504:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2393:x1875509185180416:12345-192.168.204.14@tcp:101:bash.0 Request processed in 428us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625263.585511:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 67 00000100:00080000:0.0:1788625263.586174:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625263.589636:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625263.589792:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185180544 00000100:00100000:0.0:1788625263.589804:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185180544 00000100:00100000:0.0:1788625263.589866:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 68 00000100:00100000:0.0:1788625263.589887:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:12439:x1875509185180544:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:0.0:1788625263.589908:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625263.589939:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e39a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.589999:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7b152 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e393 expref: 9 pid: 8868 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.590009:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625263.590014:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625263.590019:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.590059:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7b152 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e393 expref: 9 pid: 8868 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.590074:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7b152 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e393 expref: 9 pid: 8868 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625263.590089:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744285f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8424:1875509206203008:192.168.204.14@tcp:104: 00000100:00100000:0.0:1788625263.590225:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743798180 going to sleep for 11 seconds 00000100:00100000:3.0:1788625263.593812:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625263.593971:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185180672 00000100:00100000:2.0:1788625263.593980:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185180672 00010000:00010000:2.0:1788625263.594027:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7b152 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e393 expref: 10 pid: 8868 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625263.594069:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 97 00000100:00100000:2.0:1788625263.594079:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:2394:x1875509185180672:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625263.594095:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625263.594118:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7b152 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e393 expref: 10 pid: 8868 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.594133:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7b152 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e393 expref: 10 pid: 8868 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.594160:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625263.594165:0:9513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625263.594174:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 10 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.594195:0:9513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 10 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.594263:0:9513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 10 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625263.594279:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9513:1875509206203136:192.168.204.14@tcp:105: 00010000:00010000:0.0:1788625263.595028:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b30881/0x2d2e3b3f34a7b152 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e393 expref: 10 pid: 8868 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625263.595046:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744285f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8424:1875509206203008:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625263.595074:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.595085:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae1800, rc 0) 00000100:00100000:0.0:1788625263.595160:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:12439:x1875509185180544:12345-192.168.204.14@tcp:101:bash.0 Request processed in 5275us (5533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625263.595169:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 68 00000100:00100000:2.0:1788625263.597188:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625263.600345:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9513:1875509206203136:192.168.204.14@tcp:105: 00010000:00010000:0.0:1788625263.600378:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625263.600446:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2394:x1875509185180672:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 6367us (6644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625263.600458:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 97 00000100:00100000:1.0:1788625263.602096:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625263.602219:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185180928 00000100:00100000:3.0:1788625263.602229:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185180928 00000100:00100000:3.0:1788625263.602300:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 55 00000100:00100000:3.0:1788625263.602311:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+42:12439:x1875509185180928:12345-192.168.204.14@tcp:35:bash.0 00000100:00100000:3.0:1788625263.602982:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+43:12439:x1875509185180928:12345-192.168.204.14@tcp:35:bash.0 Request processed in 670us (893us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788625263.602992:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 55 00010000:00010000:1.0:1788625263.691799:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625263.804153:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625263.804813:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185181056 00000100:00100000:1.0:1788625263.804826:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185181056 00000100:00100000:1.0:1788625263.805077:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 216 00000100:00100000:1.0:1788625263.805091:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+43:12455:x1875509185181056:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625263.805118:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625263.805144:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7b160 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e3a1 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.805236:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b167 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.805264:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.805278:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625263.805333:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788625263.805337:0:11318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625263.805357:0:11318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.805399:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7b160 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3a1 expref: 45 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.805419:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b167 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3a1 expref: 44 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.805428:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:1.0:1788625263.805431:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625263.805435:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5800, rc 0) 00000100:00100000:1.0:1788625263.805513:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+44:12455:x1875509185181056:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 426us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625263.805564:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 216 00000100:00100000:2.0:1788625263.815060:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625263.815579:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185181312 00000100:00100000:3.0:1788625263.815590:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185181312 00000100:00100000:3.0:1788625263.815748:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 217 00000100:00100000:3.0:1788625263.815760:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+44:12455:x1875509185181312:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625263.815783:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625263.815815:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b16e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e3a8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.816013:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b175 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.816028:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b175 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.816040:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b175 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625263.816051:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788625263.817068:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b16e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3a8 expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.817510:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b175 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3a8 expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.817633:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:3.0:1788625263.817636:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625263.817640:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682e00, rc 0) 00000100:00100000:3.0:1788625263.817739:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+46:12455:x1875509185181312:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 1971us (2680us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1788625263.817747:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 217 00000100:00100000:0.0:1788625263.830856:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625263.831197:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625263.831777:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185181568 00000100:00100000:3.0:1788625263.831788:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185181568 00000100:00100000:3.0:1788625263.831849:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 218 00000100:00100000:3.0:1788625263.831858:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+46:12455:x1875509185181568:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625263.832141:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625263.832163:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b183 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e3af expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.832280:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b18a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.832295:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b18a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625263.832781:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185181696 00000100:00100000:2.0:1788625263.832788:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185181696 00000100:00100000:2.0:1788625263.832837:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00100000:2.0:1788625263.832846:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+48:2392:x1875509185181696:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625263.832858:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625263.833270:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b18a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625263.833285:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788625263.833910:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b175 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3a8 expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.833932:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:2.0:1788625263.833939:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625263.834092:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+48:2392:x1875509185181696:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 1245us (3245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625263.834102:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 15 00010000:00010000:3.0:1788625263.839676:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b183 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3af expref: 48 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.839734:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b18a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3af expref: 47 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.839744:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:3.0:1788625263.839747:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788625263.839750:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683600, rc 0) 00000100:00100000:3.0:1788625263.839835:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+47:12455:x1875509185181568:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 7976us (8636us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1788625263.839846:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 218 00000100:00100000:0.0:1788625263.850188:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625263.850360:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185181824 00000100:00100000:3.0:1788625263.850370:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185181824 00000100:00100000:3.0:1788625263.850428:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 69 00000100:00100000:3.0:1788625263.850437:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2393:x1875509185181824:12345-192.168.204.14@tcp:1:lfs.0 00010000:00010000:3.0:1788625263.850481:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000842a504c/0x2d2e3b3f34a7b198 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.850502:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.850511:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625263.850550:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625263.850556:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000842a504c/0x2d2e3b3f34a7b198 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.850595:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.850625:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 8 pid: 8424 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625263.850641:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744838380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8425:1875509206203264:192.168.204.14@tcp:104: 00000100:00100000:3.0:1788625263.850725:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887cabea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625263.853924:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744838380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8425:1875509206203264:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625263.853953:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000842a504c/0x2d2e3b3f34a7b198 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625263.854696:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625263.855555:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185181952 00000100:00100000:1.0:1788625263.855568:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185181952 00002000:00100000:1.0:1788625263.855627:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff998744287100 x1875509185181952/t0(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:74/0 lens 504/0 e 0 to 0 dl 1788625274 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625263.855640:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998744287100 with x1875509185181952 ext(0->8) 00010000:00010000:1.0:1788625263.855648:0:8429:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 9 pid: 8424 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.855665:0:8429:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 9 pid: 8424 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625263.855673:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff998744287100 00000100:00100000:1.0:1788625263.855832:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:1.0:1788625263.855842:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:2394:x1875509185181952:12345-192.168.204.14@tcp:4:lfs.0 00000100:00100000:2.0:1788625263.858116:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:2394:x1875509185181952:12345-192.168.204.14@tcp:4:lfs.0 Request processed in 2265us (3413us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788625263.858130:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 3 00002000:00100000:2.0:1788625263.858141:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff998744287100 x1875509185181952/t4294967309(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:74/0 lens 504/448 e 0 to 0 dl 1788625274 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788625263.858166:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998744287100 with x1875509185181952 ext(0->8) 00010000:00010000:2.0:1788625263.858185:0:8429:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 11 pid: 8424 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.858204:0:8429:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 11 pid: 8424 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625263.858212:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff998744287100 00000001:00080000:1.0:1788625263.861049:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788625263.861082:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1788625263.862627:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625263.862943:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185182080 00000100:00100000:2.0:1788625263.862953:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185182080 00010000:00010000:2.0:1788625263.862993:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 7 pid: 8424 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625263.863032:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 98 00000100:00100000:2.0:1788625263.863041:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185182080:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625263.863056:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788625263.863084:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788625263.863087:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788625262 00002000:00010000:2.0:1788625263.863090:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788625262 00002000:00010000:2.0:1788625263.863092:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788625262 00002000:00010000:2.0:1788625263.863094:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788625263.863100:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 7 pid: 8424 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.863113:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 7 pid: 8424 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.863151:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060fce2d9/0x2d2e3b3f34a7b159 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e39a expref: 7 pid: 8424 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.863168:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788625263.863184:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788625263.863190:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000842a504c/0x2d2e3b3f34a7b198 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.863201:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000842a504c/0x2d2e3b3f34a7b198 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.863290:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625263.863351:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+6:2393:x1875509185182080:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 310us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625263.863360:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 98 00010000:00010000:3.0:1788625263.865318:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000842a504c/0x2d2e3b3f34a7b198 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.865336:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000842a504c/0x2d2e3b3f34a7b198 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.865365:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000842a504c/0x2d2e3b3f34a7b198 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.865374:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000842a504c/0x2d2e3b3f34a7b198 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.865383:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000842a504c/0x2d2e3b3f34a7b198 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.865410:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625263.865414:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000842a504c/0x2d2e3b3f34a7b198 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.865424:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000842a504c/0x2d2e3b3f34a7b198 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.865441:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000842a504c/0x2d2e3b3f34a7b198 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.865449:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000842a504c/0x2d2e3b3f34a7b198 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625263.865718:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185181824:12345-192.168.204.14@tcp:1:lfs.0 Request processed in 15276us (15544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625263.865741:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 69 00000100:00100000:1.0:1788625263.869440:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625263.869720:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185182336 00000100:00100000:0.0:1788625263.870050:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185182336 00000100:00100000:0.0:1788625263.870233:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00100000:0.0:1788625263.870253:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866f55450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+47:12455:x1875509185182336:12345-192.168.204.14@tcp:35:lfs.0 00000004:00010000:0.0:1788625263.870324:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b18a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3af expref: 47 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788625263.870552:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1788625263.870591:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788625263.871107:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1788625263.871153:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b19f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.871171:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b144 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e38c expref: 51 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.871212:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b19f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.871253:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b144 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e38c expref: 51 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625263.871269:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b144 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e38c expref: 51 pid: 6513 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625263.871284:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744284a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6515:1875509206203392:192.168.204.14@tcp:104: 00000100:00100000:0.0:1788625263.871438:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743798180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625263.875717:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744284a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6515:1875509206203392:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625263.875750:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b19f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625263.875766:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625263.875826:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185182464 00000100:00100000:1.0:1788625263.875834:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185182464 00010000:00010000:1.0:1788625263.875941:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b144 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e38c expref: 52 pid: 6513 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625263.875976:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 99 00000100:00100000:1.0:1788625263.875987:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744829880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+52:2391:x1875509185182464:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625263.876001:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625263.876008:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b144 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e38c expref: 52 pid: 6513 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.876021:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b144 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e38c expref: 52 pid: 6513 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.876049:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1a00/0x2d2e3b3f34a7b144 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e38c expref: 52 pid: 6513 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.876065:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:1.0:1788625263.876168:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b19f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.876194:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b19f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.876214:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b19f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.876251:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625263.876306:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744829880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+51:2391:x1875509185182464:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 320us (539us total) trans 0 rc 0/0 00010000:00010000:2.0:1788625263.876401:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b19f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625263.876409:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b19f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625263.876766:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 99 00000001:00080000:2.0:1788625263.877042:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1788625263.877164:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1788625263.877281:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744830e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1875509206203520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788625263.877713:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625263.877751:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bc900 going to sleep for 11 seconds 00000100:00100000:1.0:1788625263.877798:0:14517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206203520 00000100:00100000:1.0:1788625263.877805:0:14517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206203520 00000100:00100000:1.0:1788625263.877936:0:14517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788625263.877946:0:14517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6515:x1875509206203520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1788625263.877991:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625263.878035:0:14517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6515:x1875509206203520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 91us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625263.878043:0:14517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788625263.878168:0:6515:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1788625263.878186:0:6515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1788625263.878205:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff998744051f80, transno 4294967308 00000100:00100000:2.0:1788625263.878255:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744830e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1875509206203520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788625263.878369:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788625263.878421:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744830e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1875509206203648:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788625263.878448:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625263.878470:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788625263.878686:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206203648 00000100:00100000:1.0:1788625263.878691:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206203648 00000100:00100000:1.0:1788625263.878759:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788625263.878768:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1875509206203648:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788625263.878901:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6515:x1875509206203648:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 134us (452us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788625263.878908:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788625263.878975:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744830e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1875509206203648:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788625263.879017:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1788625263.879050:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b19f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.879060:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b19f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.879140:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b19f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.879147:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625263.879151:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b19f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.879183:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b19f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.879199:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:3.0:1788625263.879201:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788625263.879206:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b19f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625263.879212:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1e00/0x2d2e3b3f34a7b19f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788625263.879297:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788625263.879349:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1788625263.879359:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384986841259ns, next at 385986839277ns, rc = 0 00000001:00080000:3.0:1788625263.879365:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1788625263.879385:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:3.0:1788625263.879387:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788625263.879393:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b18a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3af expref: 55 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625263.879470:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866f55450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+54:12455:x1875509185182336:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 9219us (10038us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788625263.879478:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 56 00000020:00080000:3.0:1788625263.879482:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788625263.881907:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625263.882170:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185182592 00000100:00100000:1.0:1788625263.882190:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185182592 00000100:00100000:1.0:1788625263.882291:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 219 00000100:00100000:1.0:1788625263.882302:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+54:12455:x1875509185182592:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625263.882325:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625263.882362:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7b1a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e3b6 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.882419:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7b1a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3b6 expref: 55 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.882439:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7b1a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3b6 expref: 55 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625263.882457:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:1.0:1788625263.882461:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625263.882465:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5400, rc 0) 00000100:00100000:1.0:1788625263.882656:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+55:12455:x1875509185182592:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 352us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625263.882663:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 219 00000100:00100000:2.0:1788625263.884188:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206203776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625263.884257:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625263.884323:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206203776 00000100:00100000:3.0:1788625263.884378:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206203776 00000100:00100000:3.0:1788625263.884435:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788625263.884444:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206203776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788625263.884478:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:0.0:1788625263.884486:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206203904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625263.884513:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625263.885033:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206203904 00000100:00100000:1.0:1788625263.885038:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206203904 00000100:00100000:1.0:1788625263.885061:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788625263.885066:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206203904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625263.885078:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:1.0:1788625263.885124:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206203904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625263.885131:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788625263.885215:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206203904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625263.887145:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206203776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2694us (2880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625263.887158:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1788625263.887209:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625263.887384:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625263.887486:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185182848 00000100:00100000:3.0:1788625263.887494:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185182848 00000100:00100000:0.0:1788625263.887734:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00100000:0.0:1788625263.887746:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+55:12455:x1875509185182848:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:0.0:1788625263.888170:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+56:12455:x1875509185182848:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 426us (787us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788625263.888189:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00100000:2.0:1788625263.889235:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206203776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625263.997450:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.000311:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185182976 00000100:00100000:0.0:1788625264.000329:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185182976 00000100:00100000:0.0:1788625264.000441:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 220 00000100:00100000:0.0:1788625264.000452:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+56:12465:x1875509185182976:12345-192.168.204.14@tcp:34:lfs.0 00010000:00010000:0.0:1788625264.000607:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7b1ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000625:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7b1ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000640:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7b1ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000652:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b1b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000660:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000666:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000741:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b1bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000750:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b1bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000757:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b1bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625264.000802:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b1bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000817:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7b1ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000830:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7b1ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000837:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7b1ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000844:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625264.000848:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7b1ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000856:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7b1ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000870:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:0.0:1788625264.000873:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625264.000878:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7b1ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000886:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0c00/0x2d2e3b3f34a7b1ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000901:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000907:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b1b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000913:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000918:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625264.000928:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000935:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b1b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000942:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988606b3e00) 00010000:00010000:0.0:1788625264.000945:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625264.000947:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b1b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000953:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b1b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000964:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b1bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000969:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b1bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000975:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b1bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000981:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625264.000985:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b1bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000991:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b1bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.000999:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:0.0:1788625264.001001:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625264.001010:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b1bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.001016:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b1bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625264.001105:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+56:12465:x1875509185182976:12345-192.168.204.14@tcp:34:lfs.0 Request processed in 653us (3664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625264.001113:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 220 00000100:00080000:3.0:1788625264.001450:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625264.057300:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625264.057402:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185183232 00000100:00100000:3.0:1788625264.057415:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185183232 00000100:00100000:3.0:1788625264.057749:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 221 00000100:00100000:3.0:1788625264.057765:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+56:12468:x1875509185183232:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625264.057789:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625264.057812:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b1c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e3bd expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.057898:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b1c9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.057914:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.057927:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.057941:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b1d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.057948:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b1d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.057971:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b1d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058079:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b1d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058088:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058096:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625264.058106:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788625264.058432:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058441:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b1c9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058449:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b1c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058455:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625264.058612:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b1c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058621:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b1c9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058635:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:3.0:1788625264.058639:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625264.058654:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b1c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058661:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683600/0x2d2e3b3f34a7b1c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058676:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b1d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058682:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b1d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058687:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b1d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058693:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625264.058696:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b1d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058702:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b1d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058711:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988606b3e00) 00010000:00010000:3.0:1788625264.058713:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625264.058716:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b1d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058721:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b1d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058762:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b1c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3bd expref: 59 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058789:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3bd expref: 58 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.058796:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:3.0:1788625264.058798:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625264.058801:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682e00, rc 0) 00000100:00100000:3.0:1788625264.058877:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:12468:x1875509185183232:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 1117us (1588us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788625264.058886:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 221 00000100:00100000:2.0:1788625264.070994:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625264.071093:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185183360 00000100:00100000:1.0:1788625264.071105:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185183360 00000100:00100000:1.0:1788625264.071289:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 222 00000100:00100000:1.0:1788625264.071315:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:12468:x1875509185183360:12345-192.168.204.14@tcp:54:lfs.0 00010000:00010000:1.0:1788625264.071396:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b1e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.071415:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.071428:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.071468:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.071477:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b1e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.071484:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.071491:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625264.071496:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.071503:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b1e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.071555:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:1.0:1788625264.071559:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625264.071565:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b1e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.071572:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b1e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625264.071658:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:12468:x1875509185183360:12345-192.168.204.14@tcp:54:lfs.0 Request processed in 346us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625264.074269:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 222 00000100:00100000:1.0:1788625264.078108:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625264.078724:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185183616 00000100:00100000:3.0:1788625264.078736:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185183616 00000100:00100000:3.0:1788625264.078788:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 58 00000100:00100000:3.0:1788625264.078797:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+58:12468:x1875509185183616:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:3.0:1788625264.079345:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:12468:x1875509185183616:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 546us (1247us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788625264.079354:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 58 00000100:00100000:2.0:1788625264.193502:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625264.193916:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185183872 00000100:00100000:1.0:1788625264.193928:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185183872 00000100:00100000:1.0:1788625264.194104:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 223 00000100:00100000:1.0:1788625264.194116:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:12479:x1875509185183872:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:1.0:1788625264.194141:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625264.194145:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788625264.194184:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7b167 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3a1 expref: 59 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.194204:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:1.0:1788625264.194210:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625264.194225:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b1ec lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e3c4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.194333:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7b1f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.194347:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7b1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.194358:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7b1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625264.194368:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788625264.194487:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b1ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3c4 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.194500:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7b1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3c4 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.194508:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:1.0:1788625264.194511:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625264.194513:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4e00, rc 0) 00000100:00100000:1.0:1788625264.194633:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:12479:x1875509185183872:12345-192.168.204.14@tcp:101:bash.0 Request processed in 519us (1141us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788625264.194641:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 223 00000100:00100000:2.0:1788625264.202673:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.202724:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.202821:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185184128 00000100:00100000:0.0:1788625264.202832:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185184128 00000100:00100000:0.0:1788625264.202915:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:0.0:1788625264.202927:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744833480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:2391:x1875509185184128:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625264.202944:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625264.202970:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4e00/0x2d2e3b3f34a7b1f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3c4 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.202990:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:0.0:1788625264.203007:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625264.203074:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744833480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:2391:x1875509185184128:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 148us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625264.203081:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:3.0:1788625264.203198:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185184000 00000100:00100000:3.0:1788625264.203203:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185184000 00000100:00100000:3.0:1788625264.203244:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 224 00000100:00100000:3.0:1788625264.203251:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+59:12479:x1875509185184000:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:3.0:1788625264.203274:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625264.203292:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b201 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e3cb expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.203337:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b208 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.203367:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.203377:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.203485:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683200/0x2d2e3b3f34a7b201 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3cb expref: 61 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.203501:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b208 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3cb expref: 60 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.203508:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:3.0:1788625264.203511:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788625264.203513:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683c00, rc 0) 00000100:00100000:3.0:1788625264.203608:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:12479:x1875509185184000:12345-192.168.204.14@tcp:101:bash.0 Request processed in 357us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625264.203615:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 224 00000100:00100000:2.0:1788625264.213085:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625264.213237:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185184384 00000100:00100000:1.0:1788625264.213249:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185184384 00000100:00100000:1.0:1788625264.213316:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 225 00000100:00100000:1.0:1788625264.213328:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+60:12479:x1875509185184384:12345-192.168.204.14@tcp:36:bash.0 00010000:00010000:1.0:1788625264.213383:0:11318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625264.213409:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682e00/0x2d2e3b3f34a7b1d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3bd expref: 60 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.213430:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:1.0:1788625264.213435:0:11318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625264.213679:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b20f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.213696:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b20f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.213707:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b20f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625264.213959:0:11318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1788625264.214054:0:11318:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e469f400 reply state 000000001d6d07b0 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b20f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.214067:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b20f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.214074:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:1.0:1788625264.214076:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788625264.214079:0:11318:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625264.215285:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+62:12479:x1875509185184384:12345-192.168.204.14@tcp:36:bash.0 Request processed in 1947us (2198us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788625264.215297:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 225 00000020:00080000:1.0:1788625264.215304:0:11318:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788625264.221009:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625264.221210:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185184512 00000100:00100000:3.0:1788625264.221221:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185184512 00000100:00100000:3.0:1788625264.221292:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 226 00000100:00100000:3.0:1788625264.221304:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+62:12479:x1875509185184512:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:3.0:1788625264.221328:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625264.221349:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b216 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e3d2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.221444:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b21d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.221473:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b21d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.221486:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b21d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625264.221554:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788625264.221559:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788625264.221583:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b21d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.221611:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b216 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3d2 expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.221629:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b21d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3d2 expref: 63 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.221637:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:3.0:1788625264.221640:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625264.221644:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be9400, rc 0) 00000100:00100000:3.0:1788625264.221712:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:12479:x1875509185184512:12345-192.168.204.14@tcp:101:bash.0 Request processed in 410us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625264.221719:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 226 00000100:00100000:3.0:1788625264.228308:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.228680:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185184768 00000100:00100000:0.0:1788625264.228691:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185184768 00000100:00100000:0.0:1788625264.228884:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 59 00000100:00100000:0.0:1788625264.228895:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+63:12479:x1875509185184768:12345-192.168.204.14@tcp:35:bash.0 00000100:00100000:0.0:1788625264.229142:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+64:12479:x1875509185184768:12345-192.168.204.14@tcp:35:bash.0 Request processed in 248us (1179us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788625264.229191:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 59 00000100:00100000:2.0:1788625264.319477:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.319770:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185184896 00000100:00100000:0.0:1788625264.319782:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185184896 00000100:00100000:0.0:1788625264.319853:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 227 00000100:00100000:0.0:1788625264.319864:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+64:12485:x1875509185184896:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:0.0:1788625264.319892:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625264.319917:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e3d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.319999:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b22b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.320015:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b22b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.320044:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b22b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625264.320099:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788625264.320104:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625264.320126:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b22b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.320154:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3d9 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.320184:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b22b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3d9 expref: 65 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.320214:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:0.0:1788625264.320217:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625264.320221:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae0e00, rc 0) 00000100:00100000:0.0:1788625264.320299:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:12485:x1875509185184896:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 438us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625264.320306:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 227 00000100:00100000:1.0:1788625264.327816:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.327922:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185185024 00000100:00100000:2.0:1788625264.327932:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185185024 00000100:00100000:2.0:1788625264.328002:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 228 00000100:00100000:2.0:1788625264.328027:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:12485:x1875509185185024:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625264.328051:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625264.328074:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7b232 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e3e0 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328148:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188600/0x2d2e3b3f34a7b239 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328175:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188600/0x2d2e3b3f34a7b239 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328187:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188600/0x2d2e3b3f34a7b239 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328198:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b240 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328205:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328212:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328293:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b247 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328301:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328307:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625264.328359:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788625264.328363:0:11318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625264.328382:0:11318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328393:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328402:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188600/0x2d2e3b3f34a7b239 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328408:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188600/0x2d2e3b3f34a7b239 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328415:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744188600/0x2d2e3b3f34a7b239 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328421:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625264.328425:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188600/0x2d2e3b3f34a7b239 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328433:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188600/0x2d2e3b3f34a7b239 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328444:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:2.0:1788625264.328447:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625264.328452:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744188600/0x2d2e3b3f34a7b239 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328459:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188600/0x2d2e3b3f34a7b239 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328481:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328487:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b240 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328493:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b240 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328498:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625264.328500:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b240 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328506:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b240 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328512:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988606b3e00) 00010000:00010000:2.0:1788625264.328625:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625264.328630:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b240 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328636:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b240 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328663:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189e00/0x2d2e3b3f34a7b232 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3e0 expref: 67 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328676:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b247 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3e0 expref: 66 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.328694:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:2.0:1788625264.328696:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625264.328699:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188c00, rc 0) 00000100:00100000:2.0:1788625264.328893:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+66:12485:x1875509185185024:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 735us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.328902:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 228 00000100:00100000:3.0:1788625264.335319:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625264.335370:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.335546:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185185408 00000100:00100000:0.0:1788625264.335556:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185185408 00000100:00100000:0.0:1788625264.335629:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:0.0:1788625264.335640:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+66:2392:x1875509185185408:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625264.335656:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625264.335682:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b247 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3e0 expref: 66 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.335704:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:0.0:1788625264.335711:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625264.335775:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:2392:x1875509185185408:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 136us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625264.335783:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:1.0:1788625264.336154:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185185280 00000100:00100000:1.0:1788625264.336159:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185185280 00000100:00100000:1.0:1788625264.336214:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 229 00000100:00100000:1.0:1788625264.336222:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:12485:x1875509185185280:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625264.336239:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625264.336257:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7b24e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e3e7 expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.336389:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.336406:0:9824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b21d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3d2 expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.336434:0:9824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.336477:0:9824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b21d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3d2 expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.336491:0:9824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b21d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3d2 expref: 66 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625264.336509:0:9824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9824:1875509206204032:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625264.336737:0:9824:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625264.345760:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.345871:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185185536 00000100:00100000:0.0:1788625264.345882:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185185536 00010000:00010000:0.0:1788625264.345922:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b21d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3d2 expref: 67 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625264.345972:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 100 00000100:00100000:0.0:1788625264.345983:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:2393:x1875509185185536:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625264.346013:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625264.346021:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b21d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3d2 expref: 67 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.346035:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b21d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3d2 expref: 67 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.346060:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:0.0:1788625264.346065:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.346076:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.346097:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.346117:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625264.346179:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:2393:x1875509185185536:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 197us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625264.346188:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 100 00010000:00010000:1.0:1788625264.349786:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b21d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3d2 expref: 66 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625264.349814:0:9824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9824:1875509206204032:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625264.349840:0:9824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.349851:0:9824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.349857:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625264.349880:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788625264.350031:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7b24e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3e7 expref: 67 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.350067:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3e7 expref: 66 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.350077:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:1.0:1788625264.350080:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788625264.350092:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4800, rc 0) 00000100:00100000:1.0:1788625264.350158:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+66:12485:x1875509185185280:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 13936us (14849us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788625264.350176:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 229 00000100:00100000:3.0:1788625264.353244:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.353333:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185185792 00000100:00100000:2.0:1788625264.353343:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185185792 00000100:00100000:2.0:1788625264.353410:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:2.0:1788625264.353421:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+66:12485:x1875509185185792:12345-192.168.204.14@tcp:103:lfs.0 00010000:00010000:2.0:1788625264.353435:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625264.353459:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7b1a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3b6 expref: 66 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.353479:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:2.0:1788625264.353484:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625264.353575:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:12485:x1875509185185792:12345-192.168.204.14@tcp:103:lfs.0 Request processed in 156us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.353583:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:2.0:1788625264.361593:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.361786:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185185920 00000100:00100000:0.0:1788625264.361796:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185185920 00000100:00100000:0.0:1788625264.361852:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 230 00000100:00100000:0.0:1788625264.361869:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:12485:x1875509185185920:12345-192.168.204.14@tcp:58:lfs.0 00010000:00010000:0.0:1788625264.362020:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b263 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.362039:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.362058:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625264.362181:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788625264.362456:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:12485:x1875509185185920:12345-192.168.204.14@tcp:58:lfs.0 Request processed in 587us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625264.362466:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 230 00000100:00100000:0.0:1788625264.372927:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.373036:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185186048 00000100:00100000:2.0:1788625264.373047:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185186048 00000100:00100000:2.0:1788625264.373198:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 231 00000100:00100000:2.0:1788625264.373209:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+65:12485:x1875509185186048:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625264.373305:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625264.373329:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b26a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e3ee expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.373389:0:11318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b263 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.373401:0:11318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b26a lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3ee expref: 66 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.373420:0:11318:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.373434:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b26a lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3ee expref: 66 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.373447:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:2.0:1788625264.373450:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625264.373454:0:11318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b26a lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3ee expref: 66 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.373461:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188400, rc 0) 00000100:00100000:2.0:1788625264.373552:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+66:12485:x1875509185186048:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 346us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.373559:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 231 00000100:00100000:0.0:1788625264.396478:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206204160:0@lo:400:kworker.0 00000100:00100000:0.0:1788625264.396570:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625264.396686:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625264.396700:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206204288:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.396734:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625264.396794:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206204416:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.396821:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625264.398729:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206204160 00000100:00100000:1.0:1788625264.398742:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206204160 00000100:00100000:1.0:1788625264.398799:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788625264.398809:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206204160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625264.399048:0:14517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206204416 00000100:00100000:3.0:1788625264.399059:0:14517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206204416 00000100:00100000:3.0:1788625264.399098:0:14517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788625264.399106:0:14517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206204416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625264.399160:0:14517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206204416:12345-0@lo:400:kworker.0 Request processed in 55us (2337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625264.399179:0:14517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788625264.399211:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206204288 00000100:00100000:3.0:1788625264.399215:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206204288 00000100:00100000:3.0:1788625264.399243:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788625264.399250:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206204288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625264.399283:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206204288:12345-0@lo:400:kworker.0 Request processed in 34us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625264.399289:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788625264.399338:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206204416:0@lo:400:kworker.0 00000100:00100000:3.0:1788625264.399351:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206204288:0@lo:400:kworker.0 00000100:00100000:3.0:1788625264.399398:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206204544:0@lo:400:kworker.0 00000100:00100000:3.0:1788625264.399438:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625264.399475:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206204544 00000100:00100000:3.0:1788625264.399479:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206204544 00000100:00100000:3.0:1788625264.399505:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788625264.399512:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206204544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625264.399577:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206204544:12345-0@lo:400:kworker.0 Request processed in 66us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625264.399584:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788625264.399609:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206204544:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.400715:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625264.400728:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206204672:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.400771:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625264.400819:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206204800:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.400842:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625264.400883:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206204800 00000100:00100000:2.0:1788625264.400887:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206204800 00000100:00080000:2.0:1788625264.400908:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625264.400939:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788625264.400946:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206204800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.400983:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206204800:12345-0@lo:400:kworker.0 Request processed in 38us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.400990:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788625264.401017:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206204800:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.401052:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206204928:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.401074:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625264.401098:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206204928 00000100:00100000:2.0:1788625264.401102:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206204928 00000100:00100000:2.0:1788625264.401128:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788625264.401134:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206204928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.401177:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206204928:12345-0@lo:400:kworker.0 Request processed in 43us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.401184:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00080000:2.0:1788625264.401198:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788625264.401227:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744833480 x1875509206204928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625264.401238:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206204928:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.401271:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206205056:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.401297:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625264.401323:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206205056 00000100:00100000:2.0:1788625264.401326:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206205056 00000100:00100000:2.0:1788625264.401354:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788625264.401360:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206205056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.401390:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206205056:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.401396:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788625264.401416:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206205056:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.401440:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625264.401446:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206205184:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.401468:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625264.401490:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206205184 00000100:00100000:2.0:1788625264.401494:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206205184 00000100:00100000:2.0:1788625264.401535:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788625264.401542:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206205184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.401575:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206205184:12345-0@lo:400:kworker.0 Request processed in 34us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.401581:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788625264.401608:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206205184:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.401639:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206205312:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.401670:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625264.401698:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206205312 00000100:00100000:2.0:1788625264.401702:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206205312 00000100:00080000:2.0:1788625264.401716:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625264.401738:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788625264.401744:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206205312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.401778:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206205312:12345-0@lo:400:kworker.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.401783:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788625264.401806:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206205312:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.401836:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206205440:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.401861:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625264.401886:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206205440 00000100:00100000:2.0:1788625264.401890:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206205440 00000100:00080000:2.0:1788625264.401902:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788625264.401923:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788625264.401929:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206205440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.401959:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206205440:12345-0@lo:400:kworker.0 Request processed in 31us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.401965:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00010000:00080000:2.0:1788625264.401987:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744284380 x1875509206205440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625264.401996:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206205440:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.402030:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206205568:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.402053:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625264.402084:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206205568 00000100:00100000:2.0:1788625264.402088:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206205568 00000100:00100000:2.0:1788625264.402111:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788625264.402115:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206205568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.402141:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206205568:12345-0@lo:400:kworker.0 Request processed in 26us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.402147:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1788625264.402159:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625264.402189:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206205568:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.402217:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625264.402224:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206205696:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.402246:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625264.402267:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206205696 00000100:00100000:2.0:1788625264.402269:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206205696 00000100:00100000:2.0:1788625264.402291:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788625264.402296:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206205696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.402323:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206205696:12345-0@lo:400:kworker.0 Request processed in 27us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.402329:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1788625264.402339:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625264.402352:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206205696:0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.402403:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206204672 00000100:00100000:2.0:1788625264.402406:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206204672 00000100:00100000:2.0:1788625264.402426:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788625264.402432:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206204672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625264.402461:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206204672:12345-0@lo:400:kworker.0 Request processed in 30us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.402475:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788625264.402513:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206204672:0@lo:400:kworker.0 00000100:00100000:1.0:1788625264.404703:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206204160:12345-0@lo:400:kworker.0 Request processed in 5887us (8124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625264.404716:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788625264.405404:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206204160:0@lo:400:kworker.0 00000040:00080000:2.0:1788625264.588023:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788625264.588033:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625264.588064:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788625264.588075:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788625264.588225:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744830000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1875509206205824:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788625264.588754:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625264.603818:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625264.604092:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185186176 00000100:00100000:3.0:1788625264.604102:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185186176 00000100:00100000:3.0:1788625264.604184:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 232 00000100:00100000:3.0:1788625264.604195:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866d43c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:12486:x1875509185186176:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788625264.604228:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788625264.604354:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866d43c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:12486:x1875509185186176:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 Request processed in 159us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625264.604361:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 232 00000100:00100000:2.0:1788625264.605920:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744830000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1875509206205824:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788625264.613408:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.613509:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185186304 00000100:00100000:2.0:1788625264.613550:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185186304 00000100:00100000:2.0:1788625264.613624:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 233 00000100:00100000:2.0:1788625264.613635:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+66:12486:x1875509185186304:12345-192.168.204.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788625264.613755:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b271 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.613776:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b271 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.613789:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b271 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.613805:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b278 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.613812:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b278 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.613837:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b278 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.613869:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b27f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.613879:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.613886:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625264.613940:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788625264.613945:0:11318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625264.613961:0:11318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.613975:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b271 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.613982:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b271 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.613990:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b271 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.613996:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625264.614001:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b271 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614010:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b271 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614033:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998743548200) 00010000:00010000:2.0:1788625264.614036:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625264.614048:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b271 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614056:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b271 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614072:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b278 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614078:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b278 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614084:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b278 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614090:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625264.614093:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b278 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614099:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b278 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614108:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9988625bef00) 00010000:00010000:2.0:1788625264.614110:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625264.614113:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b278 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614118:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b278 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614294:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614301:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b27f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614307:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b27f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614312:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625264.614315:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b27f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614322:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b27f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614330:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:2.0:1788625264.614332:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625264.614336:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b27f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.614342:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b27f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625264.614445:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+66:12486:x1875509185186304:12345-192.168.204.14@tcp:34:lhsmtool_posix.0 Request processed in 810us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.614454:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 233 00000100:00100000:1.0:1788625264.625944:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.626123:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185186560 00000100:00100000:2.0:1788625264.626135:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185186560 00000100:00100000:2.0:1788625264.626217:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 234 00000100:00100000:2.0:1788625264.626365:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+66:12486:x1875509185186560:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625264.626389:0:9824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625264.626413:0:9824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b286 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e3f5 expref: -99 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.626582:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b28d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.626612:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b28d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.626626:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b28d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625264.626640:0:9824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788625264.626733:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b28d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.626742:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b28d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.626750:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b28d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.626755:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625264.626760:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b28d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.626769:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b28d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.626783:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:2.0:1788625264.626793:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788625264.626799:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b28d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.626806:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b28d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.626870:0:9824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b286 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3f5 expref: 68 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.626881:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998743548200) 00010000:00010000:2.0:1788625264.626883:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625264.626887:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b286 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3f5 expref: 68 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.626897:0:9824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744189600, rc 0) 00000100:00100000:2.0:1788625264.626958:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:12486:x1875509185186560:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 596us (1028us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1788625264.633493:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 234 00000100:00100000:1.0:1788625264.634605:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.634700:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185186688 00000100:00100000:0.0:1788625264.634711:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185186688 00000100:00100000:0.0:1788625264.634767:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 235 00000100:00100000:0.0:1788625264.634777:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:12486:x1875509185186688:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788625264.634811:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788625264.634939:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:12486:x1875509185186688:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 Request processed in 163us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625264.634947:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 235 00000100:00100000:0.0:1788625264.640441:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.640560:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185186944 00000100:00100000:2.0:1788625264.640572:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185186944 00000100:00100000:2.0:1788625264.640638:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 236 00000100:00100000:2.0:1788625264.640649:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:12486:x1875509185186944:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625264.640670:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625264.640674:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788625264.640706:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0e00/0x2d2e3b3f34a7b22b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3d9 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.640727:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:2.0:1788625264.640746:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625264.640761:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b29b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e3fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788625264.641185:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788625264.641338:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b2a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.641352:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.641363:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.641416:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189600/0x2d2e3b3f34a7b29b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3fc expref: 69 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.641431:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b2a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3fc expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.641439:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9988625bef00) 00010000:00010000:2.0:1788625264.641442:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625264.641445:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188000, rc 0) 00000100:00100000:2.0:1788625264.641590:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+68:12486:x1875509185186944:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 936us (1153us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788625264.641599:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 236 00000100:00100000:1.0:1788625264.645810:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.645954:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185187200 00000100:00100000:2.0:1788625264.645967:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185187200 00000100:00100000:2.0:1788625264.646036:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 237 00000100:00100000:2.0:1788625264.646046:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+68:12486:x1875509185187200:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788625264.646142:0:9824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625264.646182:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188000/0x2d2e3b3f34a7b2a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3fc expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646202:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9988625bef00) 00010000:00010000:2.0:1788625264.646214:0:9824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625264.646249:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b2b0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646265:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b2b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646276:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b2b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646341:0:9824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b2b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x3b9ee939 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646350:0:9824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3b9ee939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646358:0:9824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3b9ee939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646413:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b2b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646421:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b2b0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646428:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b2b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646441:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625264.646447:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b2b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646457:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b2b0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646466:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:2.0:1788625264.646469:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625264.646472:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b2b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646478:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189a00/0x2d2e3b3f34a7b2b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646488:0:9824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3b9ee939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646493:0:9824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b2b7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3b9ee939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646500:0:9824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b2b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3b9ee939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646505:0:9824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625264.646507:0:9824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b2b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3b9ee939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646513:0:9824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b2b7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3b9ee939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646586:0:9824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x3b9ee939 (ffff9988625be900) 00010000:00010000:2.0:1788625264.646589:0:9824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625264.646593:0:9824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b2b7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x3b9ee939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.646599:0:9824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b2b7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x3b9ee939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625264.646752:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:12486:x1875509185187200:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 705us (950us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625264.646760:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 237 00000100:00100000:3.0:1788625264.649886:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.650053:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185187328 00000100:00100000:2.0:1788625264.650064:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185187328 00000100:00100000:2.0:1788625264.650186:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 238 00000100:00100000:2.0:1788625264.650198:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+67:12486:x1875509185187328:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625264.650232:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625264.650259:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b2be lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e403 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.650300:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b2c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.650315:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.650326:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.650449:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b2be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e403 expref: 69 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.650477:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e403 expref: 68 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.650487:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9988625be400) 00010000:00010000:2.0:1788625264.650489:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788625264.650493:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744189c00, rc 0) 00000100:00100000:2.0:1788625264.650808:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+68:12486:x1875509185187328:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 610us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.650816:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 238 00000100:00100000:1.0:1788625264.654385:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.655077:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185187584 00000100:00100000:0.0:1788625264.655090:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185187584 00000100:00100000:0.0:1788625264.655178:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 239 00000100:00100000:0.0:1788625264.655189:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+68:12486:x1875509185187584:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788625264.655314:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b2cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.655335:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b2cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.655347:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b2cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625264.655556:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1788625264.655567:0:6511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 385763049104ns, next at 386763046447ns, rc = 0 00000004:00010000:0.0:1788625264.655620:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000da37011 reply state 000000000cf6e352 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b2cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.655635:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b2cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.655644:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9988625be400) 00010000:00010000:0.0:1788625264.655647:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788625264.655651:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788625264.655757:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+70:12486:x1875509185187584:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 569us (1383us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788625264.655765:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 239 00000100:00100000:1.0:1788625264.658702:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.658793:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185187712 00000100:00100000:0.0:1788625264.658803:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185187712 00000100:00100000:0.0:1788625264.658947:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 240 00000100:00100000:0.0:1788625264.658958:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+70:12486:x1875509185187712:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625264.658985:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625264.659008:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1000/0x2d2e3b3f34a7b2d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e40a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.659091:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1000/0x2d2e3b3f34a7b2d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e40a expref: 71 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.659106:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1000/0x2d2e3b3f34a7b2d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e40a expref: 71 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.659127:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9988625be400) 00010000:00010000:0.0:1788625264.659130:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625264.659134:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae1000, rc 0) 00000100:00100000:0.0:1788625264.659251:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+71:12486:x1875509185187712:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 295us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625264.659258:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 240 00000100:00100000:1.0:1788625264.663561:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.663666:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185187840 00000100:00100000:2.0:1788625264.663677:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185187840 00000100:00100000:2.0:1788625264.663732:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 70 00000100:00100000:2.0:1788625264.663742:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:2393:x1875509185187840:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788625264.663998:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:2393:x1875509185187840:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 Request processed in 256us (479us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788625264.664006:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 70 00000100:00100000:1.0:1788625264.667453:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625264.667561:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185188096 00000100:00100000:3.0:1788625264.667574:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185188096 00000100:00100000:3.0:1788625264.667652:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 60 00000100:00100000:3.0:1788625264.667665:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+71:12486:x1875509185188096:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788625264.668029:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+72:12486:x1875509185188096:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 366us (587us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788625264.668038:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 60 00000100:00100000:1.0:1788625264.671078:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.671207:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185188352 00000100:00100000:2.0:1788625264.671216:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185188352 00000100:00100000:2.0:1788625264.671294:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 241 00000100:00100000:2.0:1788625264.671304:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+72:12486:x1875509185188352:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788625264.671426:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+72:12486:x1875509185188352:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 123us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.671434:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 241 00000100:00100000:1.0:1788625264.674317:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625264.674407:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185188480 00000100:00100000:3.0:1788625264.674419:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185188480 00000100:00100000:3.0:1788625264.674481:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 242 00000100:00100000:3.0:1788625264.674493:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+72:12486:x1875509185188480:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625264.674563:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625264.674586:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8400/0x2d2e3b3f34a7b2da lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e411 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.674659:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7b2e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.674691:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7b2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.674703:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7b2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625264.674756:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788625264.674778:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7b2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.674803:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8400/0x2d2e3b3f34a7b2da lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e411 expref: 74 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.674836:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7b2e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e411 expref: 73 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.674846:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9988625be400) 00010000:00010000:3.0:1788625264.674849:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788625264.674852:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be9600, rc 0) 00000100:00100000:3.0:1788625264.674924:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+73:12486:x1875509185188480:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 433us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625264.674932:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 242 00000100:00100000:1.0:1788625264.678442:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.678556:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185188608 00000100:00100000:2.0:1788625264.678581:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185188608 00000100:00100000:2.0:1788625264.678654:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 71 00000100:00100000:2.0:1788625264.678666:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+10:2394:x1875509185188608:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625264.678688:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625264.678714:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b2e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e418 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625264.678744:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c416f, blocks: 0x0 00010000:00010000:2.0:1788625264.678767:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1788625264.678772:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625264.678782:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b2e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e418 expref: 11 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.678803:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b2e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e418 expref: 11 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.678818:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188a00, rc 0) 00000100:00100000:2.0:1788625264.679071:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:2394:x1875509185188608:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 406us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.679079:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 71 00000100:00100000:1.0:1788625264.682126:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.682298:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185188864 00000100:00100000:0.0:1788625264.682309:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185188864 00000100:00100000:0.0:1788625264.682418:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 243 00000100:00100000:0.0:1788625264.682430:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+73:12486:x1875509185188864:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788625264.682590:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+73:12486:x1875509185188864:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 162us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625264.682597:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 243 00000100:00100000:1.0:1788625264.685730:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.685949:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185188992 00000100:00100000:2.0:1788625264.685959:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185188992 00000100:00100000:2.0:1788625264.686019:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 72 00000100:00100000:2.0:1788625264.686029:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:12486:x1875509185188992:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625264.686045:0:8868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625264.686064:0:8868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b2ef lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e41f expref: -99 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.686108:0:8868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b2e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e418 expref: 12 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.686118:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625264.686122:0:8868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625264.686127:0:8868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b2ef lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e41f expref: 12 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.686173:0:8868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b2e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e418 expref: 12 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.686188:0:8868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b2e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e418 expref: 12 pid: 8423 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625264.686202:0:8868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744830000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8868:1875509206205952:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625264.686456:0:8868:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625264.690320:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.690706:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185189120 00000100:00100000:0.0:1788625264.690717:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185189120 00010000:00010000:0.0:1788625264.690760:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b2e8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e418 expref: 13 pid: 8423 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625264.690804:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 101 00000100:00100000:0.0:1788625264.690828:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+13:2394:x1875509185189120:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625264.690845:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625264.690876:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b2e8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e418 expref: 13 pid: 8423 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.690891:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b2e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e418 expref: 13 pid: 8423 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.690917:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625264.690922:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625264.690930:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b2ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e41f expref: 13 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.690941:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b2ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e41f expref: 13 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.690980:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b2ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e41f expref: 13 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625264.690995:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744829500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1875509206206080:192.168.204.14@tcp:105: 00000100:00100000:0.0:1788625264.691083:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743798f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625264.693504:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744829500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1875509206206080:192.168.204.14@tcp:105: 00010000:00010000:0.0:1788625264.693672:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625264.693731:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+13:2394:x1875509185189120:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 2903us (3424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625264.693759:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 101 00010000:00010000:2.0:1788625264.694819:0:8868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b2e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e418 expref: 12 pid: 8423 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625264.694840:0:8868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744830000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8868:1875509206205952:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625264.694934:0:8868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b2ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e41f expref: 11 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.694949:0:8868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744189000, rc 0) 00000100:00100000:2.0:1788625264.695034:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:12486:x1875509185188992:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 9007us (9311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.695042:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 72 00000100:00100000:1.0:1788625264.699381:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.699470:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185189248 00000100:00100000:0.0:1788625264.699480:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185189248 00002000:00100000:0.0:1788625264.699577:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9987442d6d80 x1875509185189248/t0(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:75/0 lens 504/0 e 0 to 0 dl 1788625275 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788625264.699589:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9987442d6d80 with x1875509185189248 ext(0->12) 00002000:00010000:0.0:1788625264.699597:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9987442d6d80 00000100:00100000:0.0:1788625264.699632:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:0.0:1788625264.699643:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+11:2393:x1875509185189248:12345-192.168.204.14@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788625264.704939:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+13:2393:x1875509185189248:12345-192.168.204.14@tcp:4:lhsmtool_posix.0 Request processed in 5282us (5551us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788625264.704958:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 6 00002000:00100000:0.0:1788625264.704977:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9987442d6d80 x1875509185189248/t4294967321(0) o4->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:75/0 lens 504/448 e 0 to 0 dl 1788625275 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788625264.704989:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9987442d6d80 with x1875509185189248 ext(0->12) 00002000:00010000:0.0:1788625264.704998:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9987442d6d80 00010000:00010000:3.0:1788625264.715675:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625264.717651:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.717774:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185189376 00000100:00100000:0.0:1788625264.717783:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185189376 00000100:00100000:0.0:1788625264.717851:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 244 00000100:00100000:0.0:1788625264.717863:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+73:12486:x1875509185189376:12345-192.168.204.14@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788625264.719778:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1788625264.719794:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788625264.719838:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788625264.719861:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9987437bc900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788625264.719867:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998842c6ce00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9987437bc180 00000020:00080000:1.0:1788625264.719871:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998842c6cc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9987438e8200 00000004:00080000:1.0:1788625264.719903:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788625264.719929:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff998743798e40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788625264.719932:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998741d79300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff998743798780 00000020:00080000:1.0:1788625264.719935:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998741d79600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff998743538800 00000020:00080000:1.0:1788625264.719946:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1788625264.719970:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788625264.720038:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788625264.720089:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206206208:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788625264.720102:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206206336:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788625264.720180:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aff4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720192:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aff4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720217:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aff4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625264.720228:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206206464:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788625264.720241:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625264.720247:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aff4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720256:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aff4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720275:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9987410b7500) 00010000:00010000:3.0:1788625264.720279:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625264.720285:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aff4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720292:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5000/0x2d2e3b3f34a7aff4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720326:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b09c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720333:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b09c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720339:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b09c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720344:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625264.720346:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b09c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720362:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b09c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720371:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9988749c3600) 00010000:00010000:3.0:1788625264.720374:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625264.720377:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b09c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720383:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4400/0x2d2e3b3f34a7b09c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720402:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b11a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720409:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b11a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720415:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b11a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720420:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625264.720423:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b11a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720429:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b11a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720438:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988606b3e00) 00010000:00010000:3.0:1788625264.720441:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625264.720444:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b11a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720456:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7b11a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720469:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0000/0x2d2e3b3f34a7b13d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720475:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0000/0x2d2e3b3f34a7b13d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720480:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0000/0x2d2e3b3f34a7b13d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720486:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625264.720489:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0000/0x2d2e3b3f34a7b13d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720495:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0000/0x2d2e3b3f34a7b13d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720505:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9988606b3e00) 00010000:00010000:3.0:1788625264.720507:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625264.720509:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0000/0x2d2e3b3f34a7b13d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720515:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0000/0x2d2e3b3f34a7b13d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720577:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b20f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720585:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b20f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720597:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b20f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720603:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625264.720606:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b20f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720613:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b20f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720621:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:3.0:1788625264.720624:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625264.720627:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b20f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720633:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7b20f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720648:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b2cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720654:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b2cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720661:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b2cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720666:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625264.720669:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b2cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720686:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b2cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720695:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9988625be400) 00010000:00010000:3.0:1788625264.720698:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788625264.720702:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b2cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.720708:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1600/0x2d2e3b3f34a7b2cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625264.721273:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625264.721741:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206206208 00000100:00100000:3.0:1788625264.721750:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206206208 00000100:00100000:3.0:1788625264.721803:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788625264.721812:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1875509206206208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788625264.721846:0:8424:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:3.0:1788625264.721887:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a3e86c8/0x2d2e3b3f34a7b2f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.721910:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9e57d5c/0x2d2e3b3f34a7b0aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e377 expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.721920:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788625264.721924:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625264.721929:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a3e86c8/0x2d2e3b3f34a7b2f6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.721965:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9e57d5c/0x2d2e3b3f34a7b0aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e377 expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.721991:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9e57d5c/0x2d2e3b3f34a7b0aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e377 expref: 12 pid: 8424 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625264.722008:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744838e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8424:1875509206206592:192.168.204.14@tcp:104: 00000100:00100000:3.0:1788625264.722083:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887cabef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625264.722187:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625264.722309:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206206464 00000100:00100000:0.0:1788625264.722314:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206206464 00000100:00100000:0.0:1788625264.722359:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788625264.722368:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206206464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788625264.722383:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:0.0:1788625264.722414:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c416e, atime: 0x6a9c416e, ctime: 0x6a9c416e, blocks: 0x8 00010000:00010000:0.0:1788625264.722420:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8aae9c2/0x2d2e3b3f34a7b2fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.722431:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:0.0:1788625264.722434:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625264.722440:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8aae9c2/0x2d2e3b3f34a7b2fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.722455:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8aae9c2/0x2d2e3b3f34a7b2fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.722467:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8aae9c2/0x2d2e3b3f34a7b2fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.722474:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8aae9c2/0x2d2e3b3f34a7b2fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.722501:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788625264.722736:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1875509206206464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 369us (548us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788625264.722744:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788625264.722776:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625264.722797:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206206336 00000100:00100000:0.0:1788625264.722806:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206206336 00000100:00100000:0.0:1788625264.722835:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788625264.722843:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1875509206206336:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1788625264.722847:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff998744831880/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788625264.722856:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206206464:0@lo:6:osp-syn-0-0.0 00002000:00010000:0.0:1788625264.722922:0:8423:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788625264.722926:0:8423:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788625263 00002000:00010000:0.0:1788625264.722928:0:8423:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788625264.722930:0:8423:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788625263 -> 1788625263 00002000:00010000:0.0:1788625264.722933:0:8423:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788625264.722959:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3638:x1875509206206336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (182us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788625264.722966:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:0.0:1788625264.722995:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99874482aa00/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788625264.723000:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206206336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788625264.723112:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:12486:x1875509185189376:12345-192.168.204.14@tcp:44:lhsmtool_posix.0 Request processed in 5249us (5469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625264.723121:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 244 00010000:00010000:1.0:1788625264.724862:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625264.724878:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8aae9c2/0x2d2e3b3f34a7b2fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.724893:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625264.724913:0:10330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8aae9c2/0x2d2e3b3f34a7b2fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.724925:0:10330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8aae9c2/0x2d2e3b3f34a7b2fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.724948:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8aae9c2/0x2d2e3b3f34a7b2fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.724957:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8aae9c2/0x2d2e3b3f34a7b2fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.724980:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625264.724982:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625264.724984:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625264.726771:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744838e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8424:1875509206206592:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625264.726811:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005a3e86c8/0x2d2e3b3f34a7b2f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625264.735487:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.735726:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185189632 00000100:00100000:0.0:1788625264.735737:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185189632 00000100:00100000:0.0:1788625264.735876:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 76 00000100:00100000:0.0:1788625264.735888:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+13:2393:x1875509185189632:12345-192.168.204.14@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788625264.737452:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.739310:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185189504 00000100:00100000:0.0:1788625264.739326:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185189504 00010000:00010000:0.0:1788625264.739391:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e57d5c/0x2d2e3b3f34a7b0aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e377 expref: 14 pid: 8424 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625264.739443:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 102 00000100:00100000:0.0:1788625264.739453:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+14:2393:x1875509185189504:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625264.739483:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625264.739490:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9e57d5c/0x2d2e3b3f34a7b0aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e377 expref: 14 pid: 8424 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.739506:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9e57d5c/0x2d2e3b3f34a7b0aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e377 expref: 14 pid: 8424 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.739562:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9e57d5c/0x2d2e3b3f34a7b0aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e377 expref: 14 pid: 8424 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.739581:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788625264.739586:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00000001:00080000:3.0:1788625264.739590:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00010000:00010000:0.0:1788625264.739594:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a3e86c8/0x2d2e3b3f34a7b2f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788625264.739602:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00010000:00010000:0.0:1788625264.739606:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a3e86c8/0x2d2e3b3f34a7b2f6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.739640:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625264.739838:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2393:x1875509185189632:12345-192.168.204.14@tcp:16:lhsmtool_posix.0 Request processed in 3950us (4362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625264.739859:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 76 00000100:00100000:0.0:1788625264.742414:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185189504:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 2948us (4956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625264.742432:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 102 00010000:00010000:0.0:1788625264.742484:0:8424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005a3e86c8/0x2d2e3b3f34a7b2f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.742498:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a3e86c8/0x2d2e3b3f34a7b2f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.742546:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a3e86c8/0x2d2e3b3f34a7b2f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.742555:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a3e86c8/0x2d2e3b3f34a7b2f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.742577:0:8424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788625264.742792:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1875509206206208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20980us (21520us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788625264.742801:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788625264.744662:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.745666:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185189888 00000100:00100000:2.0:1788625264.745678:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185189888 00000100:00100000:2.0:1788625264.745754:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 245 00000100:00100000:2.0:1788625264.745765:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:12486:x1875509185189888:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788625264.745822:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625264.745862:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7b2e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e411 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.745882:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9988625be400) 00010000:00010000:2.0:1788625264.745888:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625264.745925:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b304 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.745941:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.745953:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625264.746085:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000706deb78 reply state 0000000047635e19 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.746103:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b304 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.746127:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9988625be400) 00010000:00010000:2.0:1788625264.746130:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625264.746133:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625264.746279:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:12486:x1875509185189888:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 516us (1760us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788625264.746288:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 245 00010000:00010000:1.0:1788625264.746984:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625264.746995:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a3e86c8/0x2d2e3b3f34a7b2f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.747006:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625264.747011:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a3e86c8/0x2d2e3b3f34a7b2f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.747021:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a3e86c8/0x2d2e3b3f34a7b2f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.747050:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a3e86c8/0x2d2e3b3f34a7b2f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.747059:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a3e86c8/0x2d2e3b3f34a7b2f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.747083:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625264.747085:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625264.747087:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625264.748707:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1788625264.748718:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1788625264.748737:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99874482aa00, transno 4294967322 00000100:00100000:1.0:1788625264.748761:0:3637:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff998744829500 x1875509206206208/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788625280 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788625264.748774:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff998744829500/2, rc 0, transno 4294967323 00000100:00100000:1.0:1788625264.748780:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206206208:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788625264.752671:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.752833:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185190016 00000100:00100000:2.0:1788625264.752855:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185190016 00000100:00100000:2.0:1788625264.752915:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 77 00000100:00100000:2.0:1788625264.752927:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2392:x1875509185190016:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788625264.753096:0:8868:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788625264.753100:0:8868:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788625263 -> 1788625263 00002000:00010000:2.0:1788625264.753103:0:8868:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788625262 00002000:00010000:2.0:1788625264.753105:0:8868:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788625263 -> 1788625263 00002000:00010000:2.0:1788625264.753107:0:8868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788625264.753177:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2392:x1875509185190016:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 Request processed in 253us (517us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788625264.753185:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 77 00000100:00100000:1.0:1788625264.756841:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.757076:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185190272 00000100:00100000:0.0:1788625264.757087:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185190272 00000100:00100000:0.0:1788625264.757149:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 246 00000100:00100000:0.0:1788625264.757171:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:12486:x1875509185190272:12345-192.168.204.14@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788625264.757248:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7b30b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.757269:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b2c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e403 expref: 22 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.757279:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7b30b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.757320:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e403 expref: 22 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.757356:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b2c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e403 expref: 22 pid: 11318 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625264.757386:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206206720:192.168.204.14@tcp:104: 00000100:00100000:0.0:1788625264.757485:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743798d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625264.770858:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625264.770966:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185190400 00000100:00100000:1.0:1788625264.770976:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185190400 00010000:00010000:1.0:1788625264.771024:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b2c5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e403 expref: 23 pid: 11318 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625264.771072:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 103 00000100:00100000:1.0:1788625264.771083:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+23:2394:x1875509185190400:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625264.771100:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625264.771123:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b2c5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e403 expref: 23 pid: 11318 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.771139:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b2c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e403 expref: 23 pid: 11318 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.771179:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9988625be400) 00010000:00010000:1.0:1788625264.771185:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7b30b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.771197:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7b30b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.771206:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7b30b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.771240:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625264.771246:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b2c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e403 expref: 23 pid: 11318 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625264.771270:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206206720:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625264.771297:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7b30b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.771307:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7b30b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625264.771315:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:2394:x1875509185190400:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 231us (476us total) trans 0 rc 0/0 00010000:00010000:0.0:1788625264.771316:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7b30b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625264.771345:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 103 00010000:00010000:0.0:1788625264.771380:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7b30b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.771390:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7b30b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.771397:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7b30b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.771403:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625264.771413:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7b30b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.771421:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7b30b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.771432:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9988625be400) 00010000:00010000:0.0:1788625264.771435:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788625264.771438:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7b30b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.771446:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1200/0x2d2e3b3f34a7b30b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625264.771790:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:12486:x1875509185190272:12345-192.168.204.14@tcp:55:lhsmtool_posix.0 Request processed in 14630us (14960us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788625264.771803:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 246 00000100:00100000:2.0:1788625264.777992:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625264.778078:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185190528 00000100:00100000:1.0:1788625264.778088:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185190528 00000100:00100000:1.0:1788625264.778166:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 78 00000100:00100000:1.0:1788625264.778178:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2392:x1875509185190528:12345-192.168.204.14@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788625264.778236:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7b312 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.778278:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b2ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e41f expref: 8 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.778287:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625264.778291:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788625264.778296:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7b312 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.778337:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b2ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e41f expref: 8 pid: 8868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.778353:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b2ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e41f expref: 8 pid: 8868 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625264.778378:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1875509206206848:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625264.781144:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861180 going to sleep for 11 seconds 00000100:00100000:1.0:1788625264.785381:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1875509206206848:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625264.785422:0:8423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7b312 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625264.787824:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.788881:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185190656 00000100:00100000:2.0:1788625264.788899:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185190656 00010000:00010000:2.0:1788625264.788952:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b2ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e41f expref: 9 pid: 8868 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625264.789001:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 104 00000100:00100000:2.0:1788625264.789026:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+9:2393:x1875509185190656:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625264.789043:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625264.789089:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b2ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e41f expref: 9 pid: 8868 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.789107:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b2ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e41f expref: 9 pid: 8868 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.789133:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b2ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e41f expref: 9 pid: 8868 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.789151:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788625264.789172:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788625264.789179:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7b312 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.789191:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7b312 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.789293:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625264.789361:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2393:x1875509185190656:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 336us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.789369:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 104 00010000:00010000:1.0:1788625264.791114:0:8423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7b312 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.791132:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7b312 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.791343:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7b312 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.791354:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7b312 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.791361:0:8423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7b312 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.791369:0:8423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625264.791373:0:8423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7b312 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.791383:0:8423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7b312 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.791402:0:8423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7b312 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.791409:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7b312 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625264.791689:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2392:x1875509185190528:12345-192.168.204.14@tcp:1:lhsmtool_posix.0 Request processed in 13508us (13703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625264.791700:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 78 00000100:00100000:0.0:1788625264.809484:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.809684:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185190912 00000100:00100000:2.0:1788625264.809695:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185190912 00000100:00100000:2.0:1788625264.809763:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 247 00000100:00100000:2.0:1788625264.809773:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:12486:x1875509185190912:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788625264.810012:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b319 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.810031:0:11318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b208 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3cb expref: 21 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.810041:0:11318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b319 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.810077:0:11318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b208 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3cb expref: 21 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.810091:0:11318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b208 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3cb expref: 21 pid: 9824 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625264.810105:0:11318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11318:1875509206206976:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625264.810219:0:11318:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625264.813688:0:11318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11318:1875509206206976:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625264.813725:0:11318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b319 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625264.815236:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.816207:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185191040 00000100:00100000:2.0:1788625264.816222:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185191040 00010000:00010000:2.0:1788625264.816276:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b208 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3cb expref: 22 pid: 9824 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625264.817111:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 105 00000100:00100000:2.0:1788625264.817131:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744828380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:2393:x1875509185191040:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625264.817179:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625264.817189:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b208 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3cb expref: 22 pid: 9824 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.817206:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b208 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3cb expref: 22 pid: 9824 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.817231:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7b208 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3cb expref: 22 pid: 9824 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.817251:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:2.0:1788625264.817257:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b26a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3ee expref: 21 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.817269:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b319 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.817277:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.817284:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b319 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.817331:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625264.817398:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744828380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:2393:x1875509185191040:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 276us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.817406:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 105 00010000:00010000:3.0:1788625264.817474:0:11318:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.817484:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.817708:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b320 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.817732:0:11318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1000/0x2d2e3b3f34a7b2d3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e40a expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.817739:0:11318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b320 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.817773:0:11318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1000/0x2d2e3b3f34a7b2d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e40a expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.817787:0:11318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1000/0x2d2e3b3f34a7b2d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e40a expref: 21 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625264.817801:0:11318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11318:1875509206207104:192.168.204.14@tcp:104: 00000100:00100000:3.0:1788625264.817949:0:11318:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887cabed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625264.823434:0:11318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11318:1875509206207104:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625264.823490:0:11318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b320 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625264.832342:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.832414:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185191168 00000100:00100000:2.0:1788625264.832426:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185191168 00010000:00010000:2.0:1788625264.832468:0:9513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1000/0x2d2e3b3f34a7b2d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e40a expref: 22 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625264.832547:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 106 00000100:00100000:2.0:1788625264.832560:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:2393:x1875509185191168:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625264.832576:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625264.832583:0:9513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1000/0x2d2e3b3f34a7b2d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e40a expref: 22 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.832597:0:9513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1000/0x2d2e3b3f34a7b2d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e40a expref: 22 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.832620:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae1000/0x2d2e3b3f34a7b2d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e40a expref: 22 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.832639:0:9513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9988625be400) 00010000:00010000:2.0:1788625264.832644:0:9513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b320 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.832653:0:9513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b320 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.832662:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b320 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.832708:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625264.832763:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:2393:x1875509185191168:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 205us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.832771:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 106 00010000:00010000:3.0:1788625264.832902:0:11318:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b320 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.832912:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b320 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788625264.833021:0:11318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1788625264.833119:0:11318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1788625264.833151:0:11318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1788625264.833818:0:11318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744830700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11318:1875509206207232:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788625264.833871:0:11318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625264.833911:0:11318:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788625264.834356:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206207232 00000100:00100000:3.0:1788625264.834364:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206207232 00000100:00100000:3.0:1788625264.834414:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788625264.834421:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11318:x1875509206207232:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788625264.834923:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11318:x1875509206207232:12345-0@lo:1000:mdt00_004.0 Request processed in 500us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625264.834947:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788625264.835382:0:11318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744830700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11318:1875509206207232:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1788625264.835635:0:11318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1788625264.835712:0:11318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11318:1875509206207360:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788625264.835757:0:11318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625264.835787:0:11318:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861600 going to sleep for 11 seconds 00000100:00100000:2.0:1788625264.835812:0:14517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206207360 00000100:00100000:2.0:1788625264.835818:0:14517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206207360 00000100:00100000:2.0:1788625264.835856:0:14517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788625264.835863:0:14517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:11318:x1875509206207360:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788625264.836546:0:14517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:11318:x1875509206207360:12345-0@lo:1000:mdt00_004.0 Request processed in 680us (785us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788625264.836555:0:14517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788625264.837929:0:11318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11318:1875509206207360:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1788625264.837987:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b320 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.837998:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b320 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.838007:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b320 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.838012:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625264.838017:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b320 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.838026:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b320 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.838042:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9988625be400) 00010000:00010000:1.0:1788625264.838045:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625264.838049:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b320 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.838056:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7b320 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.838083:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.838107:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b263 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.838113:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b263 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.838117:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625264.838121:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b263 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.838127:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b263 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.838136:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:1.0:1788625264.838138:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625264.838146:0:11318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b26a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3ee expref: 24 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.838176:0:11318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b26a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3ee expref: 24 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.838185:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b26a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3ee expref: 24 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.838238:0:11318:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b26a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3ee expref: 24 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625264.838253:0:11318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11318:1875509206207488:192.168.204.14@tcp:105: 00000100:00100000:1.0:1788625264.838382:0:11318:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625264.841988:0:11318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11318:1875509206207488:192.168.204.14@tcp:105: 00010000:00010000:1.0:1788625264.842022:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b263 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842033:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0a00/0x2d2e3b3f34a7b263 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842067:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7b327 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842083:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7b327 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842095:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7b327 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842105:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7b327 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842112:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7b327 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842119:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7b327 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842125:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625264.842129:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7b327 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842136:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7b327 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842188:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:1.0:1788625264.842191:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625264.842196:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7b327 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842202:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7b327 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842213:0:11318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842219:0:11318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b319 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842225:0:11318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b319 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842230:0:11318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625264.842233:0:11318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b319 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842238:0:11318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b319 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842246:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:1.0:1788625264.842248:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788625264.842251:0:11318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b319 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.842256:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189000/0x2d2e3b3f34a7b319 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625264.842292:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625264.842448:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:12486:x1875509185190912:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 32674us (32971us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788625264.842460:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 247 00000020:00080000:1.0:1788625264.842467:0:11318:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788625264.842589:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788625264.842594:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788625264.843044:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185191296 00000100:00100000:0.0:1788625264.843053:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185191296 00000100:00100000:0.0:1788625264.843103:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 61 00000100:00100000:0.0:1788625264.843113:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:12485:x1875509185191296:12345-192.168.204.14@tcp:49:lfs.0 00000040:00080000:2.0:1788625264.843175:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788625264.843184:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788625264.843246:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:12485:x1875509185191296:12345-192.168.204.14@tcp:49:lfs.0 Request processed in 133us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625264.843254:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 61 00000100:00100000:3.0:1788625264.846117:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625264.846374:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185191552 00000100:00100000:2.0:1788625264.846384:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185191552 00000100:00100000:2.0:1788625264.846438:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 248 00000100:00100000:2.0:1788625264.846449:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:12485:x1875509185191552:12345-192.168.204.14@tcp:58:lfs.0 00000040:00080000:2.0:1788625264.846714:0:9824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788625264.847255:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:12485:x1875509185191552:12345-192.168.204.14@tcp:58:lfs.0 Request processed in 804us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.847264:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 248 00000100:00100000:0.0:1788625264.860675:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625264.860963:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185191808 00000100:00100000:3.0:1788625264.860975:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185191808 00000100:00100000:3.0:1788625264.861036:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 62 00000100:00100000:3.0:1788625264.861046:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866f56450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+24:12486:x1875509185191808:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788625264.861349:0:12000:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788625264.861381:0:12000:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1788625264.861416:0:12000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8400/0x2d2e3b3f34a7b32e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12000 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.861434:0:12000:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8400/0x2d2e3b3f34a7b32e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12000 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.861447:0:12000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8400/0x2d2e3b3f34a7b32e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12000 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.861455:0:12000:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8400/0x2d2e3b3f34a7b32e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12000 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.861461:0:12000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8400/0x2d2e3b3f34a7b32e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12000 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.861479:0:12000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8400/0x2d2e3b3f34a7b32e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12000 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625264.861503:0:12000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788625264.861620:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866f56450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+26:12486:x1875509185191808:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 574us (955us total) trans 4294967516 rc 0/0 00010000:00010000:1.0:1788625264.861624:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625264.861633:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8400/0x2d2e3b3f34a7b32e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12000 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.861645:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8400 already unused, calling callback (ffffffffc0dba4f0) 00000100:00100000:3.0:1788625264.861652:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 62 00010000:00010000:1.0:1788625264.861652:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8400/0x2d2e3b3f34a7b32e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12000 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788625264.861660:0:12000:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788625264.861665:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8400/0x2d2e3b3f34a7b32e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12000 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.861680:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9988625be400) 00010000:00010000:1.0:1788625264.861684:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788625264.861699:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8400/0x2d2e3b3f34a7b32e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12000 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.861706:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8400/0x2d2e3b3f34a7b32e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12000 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.861724:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625264.861727:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625264.861728:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625264.900483:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625264.901051:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185191936 00000100:00100000:1.0:1788625264.901064:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185191936 00000100:00100000:1.0:1788625264.901137:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 249 00000100:00100000:1.0:1788625264.901150:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+26:12488:x1875509185191936:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625264.901205:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625264.901232:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7b335 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e426 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.901309:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7b33c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.901327:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7b33c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.901344:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7b33c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.901359:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b343 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.901367:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.901374:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.901449:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b34a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.901460:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3e7 expref: 27 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.901468:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b34a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.901505:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3e7 expref: 27 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625264.901569:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3e7 expref: 27 pid: 9824 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625264.901584:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206207616:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625264.901702:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861840 going to sleep for 11 seconds 00000100:00100000:1.0:1788625264.905716:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1875509206207616:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625264.905753:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b34a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625264.907791:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625264.907821:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206207744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625264.907896:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625264.907944:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206207744 00000100:00100000:1.0:1788625264.907965:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206207744 00000100:00100000:1.0:1788625264.908026:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788625264.908037:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625264.908038:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206207744:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625264.908050:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206207872:0@lo:13:osp-pre-1-0.0 00000004:00000024:1.0:1788625264.908074:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788625264.908086:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625264.910066:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206207872 00000100:00100000:3.0:1788625264.910080:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206207872 00000100:00100000:3.0:1788625264.910208:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788625264.910219:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875509206207872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788625264.910246:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1788625264.918425:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206207744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10379us (10517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625264.918443:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788625264.918496:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625264.918529:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206208000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625264.918599:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625264.918645:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206208000 00000100:00100000:1.0:1788625264.918653:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206208000 00000100:00100000:1.0:1788625264.918688:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788625264.918697:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206208000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788625264.918726:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1788625264.918787:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206208000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625264.918794:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788625264.918856:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206208000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625264.920754:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206207744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625264.925247:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875509206207872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14971us (17102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625264.925263:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788625264.925264:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206207872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625264.926099:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.926195:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185192192 00000100:00100000:0.0:1788625264.926203:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185192192 00000100:00100000:0.0:1788625264.926261:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 63 00000100:00100000:0.0:1788625264.926270:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+28:6162:x1875509185192192:12345-192.168.204.14@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788625264.926478:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+29:6162:x1875509185192192:12345-192.168.204.14@tcp:35:ldlm_bl.0 Request processed in 208us (382us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788625264.926485:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 63 00000100:00100000:3.0:1788625264.931372:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625264.931925:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185192320 00000100:00100000:0.0:1788625264.931936:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185192320 00010000:00010000:0.0:1788625264.931992:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3e7 expref: 29 pid: 9824 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625264.932037:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 107 00000100:00100000:0.0:1788625264.932047:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+29:2394:x1875509185192320:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625264.932061:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625264.932068:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3e7 expref: 29 pid: 9824 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.932082:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3e7 expref: 29 pid: 9824 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.932105:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7b255 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3e7 expref: 29 pid: 9824 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.932122:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:0.0:1788625264.932145:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b34a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.932167:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b34a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.932175:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b34a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625264.932210:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625264.932274:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+28:2394:x1875509185192320:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 229us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625264.932282:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 107 00010000:00010000:2.0:1788625264.932418:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b34a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932427:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b34a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625264.932480:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788625264.932485:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625264.932506:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b34a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932557:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b34a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932567:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7b33c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932573:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7b33c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932580:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7b33c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932585:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625264.932589:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7b33c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932597:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7b33c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932606:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:2.0:1788625264.932618:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625264.932623:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7b33c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932630:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5200/0x2d2e3b3f34a7b33c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932643:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932650:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b343 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932656:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b343 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932662:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625264.932665:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b343 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932671:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b343 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932678:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9987410b4000) 00010000:00010000:2.0:1788625264.932681:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625264.932684:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b343 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932689:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7b343 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932724:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5a00/0x2d2e3b3f34a7b335 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e426 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932750:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b34a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e426 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625264.932758:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:2.0:1788625264.932761:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625264.932763:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4600, rc 0) 00000100:00100000:2.0:1788625264.932793:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+27:12488:x1875509185191936:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 31647us (32331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625264.932812:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 249 00010000:00010000:0.0:1788625265.744798:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788625265.794347:0:14804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788625265.794357:0:14804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625265.796621:0:14804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788625265.796633:0:14804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788625265.869798:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788625265.869809:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788625265.869840:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788625265.869847:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788625265.869989:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744839f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1875509206208128:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788625265.870232:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788625265.897140:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625265.897307:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185192448 00000100:00100000:0.0:1788625265.897318:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185192448 00000100:00100000:0.0:1788625265.897385:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 250 00000100:00100000:0.0:1788625265.897398:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+28:12500:x1875509185192448:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788625265.897439:0:11318:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788625265.897591:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+28:12500:x1875509185192448:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 Request processed in 196us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625265.897599:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 250 00000100:00100000:2.0:1788625265.899313:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744839f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1875509206208128:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788625265.907827:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625265.907905:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185192704 00000100:00100000:3.0:1788625265.907916:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185192704 00000100:00100000:3.0:1788625265.908002:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 251 00000100:00100000:3.0:1788625265.908015:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+27:12500:x1875509185192704:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625265.908037:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625265.908061:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7b351 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e42d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625265.913180:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b358 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625265.913208:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b358 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625265.913229:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b358 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625265.913251:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788625265.913407:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7b351 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e42d expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625265.913428:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b358 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e42d expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625265.913438:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:3.0:1788625265.913442:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625265.913446:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be9400, rc 0) 00000100:00100000:3.0:1788625265.913558:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+29:12500:x1875509185192704:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 5545us (5739us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788625265.913569:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 251 00000100:00100000:1.0:1788625265.919427:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625265.919504:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625265.921198:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185192960 00000100:00100000:2.0:1788625265.921216:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185192960 00000100:00100000:2.0:1788625265.921287:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 252 00000100:00100000:2.0:1788625265.921298:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+29:12500:x1875509185192960:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788625265.921383:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b366 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625265.921403:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b366 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625265.921417:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b366 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625265.921885:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b366 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625265.921895:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b366 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625265.921903:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b366 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625265.921909:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625265.921986:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b366 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625265.921996:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b366 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625265.922009:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:2.0:1788625265.922012:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788625265.922018:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b366 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625265.922024:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189c00/0x2d2e3b3f34a7b366 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625265.922184:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+30:12500:x1875509185192960:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 885us (2766us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788625265.922193:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 252 00000100:00100000:3.0:1788625265.922253:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185193088 00000100:00100000:3.0:1788625265.922260:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185193088 00000100:00100000:3.0:1788625265.922299:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:3.0:1788625265.922309:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+30:2391:x1875509185193088:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625265.922324:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625265.922349:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b358 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e42d expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625265.922360:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:3.0:1788625265.922364:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625265.922384:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+29:2391:x1875509185193088:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 78us (2880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625265.922392:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 19 00000040:00080000:2.0:1788625265.922895:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788625265.922901:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625265.923454:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788625265.923476:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788625265.925378:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625265.925468:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185193344 00000100:00100000:3.0:1788625265.925481:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185193344 00000100:00100000:3.0:1788625265.925585:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:3.0:1788625265.925601:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+29:12500:x1875509185193344:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788625265.926942:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+30:12500:x1875509185193344:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 1332us (1561us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788625265.926954:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:1.0:1788625266.685091:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625266.685220:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625266.685255:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625266.685304:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185193856 00000100:00100000:3.0:1788625266.685314:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185193856 00000100:00100000:3.0:1788625266.685407:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 130 00000100:00080000:0.0:1788625266.685699:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625266.686288:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185193856:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625266.686399:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185193856:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 980us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625266.686408:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 130 00000100:00100000:1.0:1788625266.690811:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625266.690851:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625266.690953:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185193472 00000100:00100000:3.0:1788625266.690963:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185193472 00000100:00100000:3.0:1788625266.691029:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 389 00000100:00100000:3.0:1788625266.691038:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185193472:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625266.691108:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185193472:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 71us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625266.691127:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 389 00000100:00100000:2.0:1788625266.696717:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185193600 00000100:00100000:2.0:1788625266.696737:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185193600 00000100:00100000:2.0:1788625266.696831:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185194112 00000100:00100000:2.0:1788625266.696835:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185194112 00000100:00100000:2.0:1788625266.696874:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185193728 00000100:00100000:2.0:1788625266.696878:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185193728 00000100:00100000:2.0:1788625266.696901:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 322 00000100:00100000:2.0:1788625266.696916:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+30:2393:x1875509185193600:12345-192.168.204.14@tcp:400:kworker.0 00000100:00080000:0.0:1788625266.696937:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788625266.696944:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625266.696953:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 323 00000100:00100000:0.0:1788625266.696965:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 324 00000100:00100000:3.0:1788625266.696967:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185194112:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625266.696981:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185193728:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625266.697039:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625266.699087:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+30:2393:x1875509185193600:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 2166us (14060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625266.699100:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 322 00000100:00100000:3.0:1788625266.699210:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185194112:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 2245us (13951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625266.699220:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 323 00000100:00100000:3.0:1788625266.699486:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185193984 00000100:00100000:3.0:1788625266.699494:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185193984 00000100:00100000:3.0:1788625266.699600:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 131 00000100:00100000:3.0:1788625266.699610:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998874f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185193984:12345-192.168.204.14@tcp:400:kworker.0 00000100:00080000:2.0:1788625266.699713:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625266.699942:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998874f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185193984:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 332us (2902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625266.699949:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 131 00000100:00100000:0.0:1788625266.701913:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185193728:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 4925us (11046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625266.701947:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 324 00000100:00100000:1.0:1788625266.703939:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625266.704080:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185194240 00000100:00100000:2.0:1788625266.704091:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185194240 00000100:00100000:2.0:1788625266.704183:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 325 00000100:00100000:2.0:1788625266.704194:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185194240:12345-192.168.204.14@tcp:400:kworker.0 00000100:00080000:0.0:1788625266.704340:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788625266.704378:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185194240:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 185us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625266.704385:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 325 00010000:00010000:1.0:1788625266.764089:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625267.767322:0:14855:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788625267.767332:0:14855:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788625267.767364:0:14855:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788625267.767372:0:14855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788625267.791132:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625268.077106:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625268.077227:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185194496 00000100:00100000:3.0:1788625268.077238:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185194496 00000100:00100000:3.0:1788625268.077379:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 253 00000100:00100000:3.0:1788625268.077390:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+30:12520:x1875509185194496:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625268.077412:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625268.077434:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8400/0x2d2e3b3f34a7b36d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e434 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625268.077710:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b374 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625268.077738:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b374 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625268.077752:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b374 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625268.077766:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788625268.077883:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8400/0x2d2e3b3f34a7b36d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e434 expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625268.077904:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b374 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e434 expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625268.077912:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:3.0:1788625268.077915:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788625268.077919:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be9400, rc 0) 00000100:00100000:3.0:1788625268.078027:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+32:12520:x1875509185194496:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 639us (943us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788625268.078035:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 253 00000100:00080000:0.0:1788625268.079308:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625268.095600:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625268.095672:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185194624 00000100:00100000:2.0:1788625268.095682:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185194624 00000100:00100000:2.0:1788625268.095743:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 254 00000100:00100000:2.0:1788625268.095752:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+32:12520:x1875509185194624:12345-192.168.204.14@tcp:54:lfs.0 00010000:00010000:2.0:1788625268.095835:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b382 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625268.095853:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625268.095866:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625268.095902:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625268.095910:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b382 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625268.095917:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625268.095923:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625268.095927:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625268.095934:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b382 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625268.095945:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:2.0:1788625268.095948:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625268.095953:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b382 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625268.095959:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188c00/0x2d2e3b3f34a7b382 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625268.096041:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+32:12520:x1875509185194624:12345-192.168.204.14@tcp:54:lfs.0 Request processed in 289us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625268.096049:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 254 00000100:00100000:2.0:1788625268.263125:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625268.263248:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185194752 00000100:00100000:0.0:1788625268.263264:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185194752 00000100:00080000:2.0:1788625268.263394:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625268.263400:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 79 00000100:00100000:0.0:1788625268.263420:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185194752:12345-192.168.204.14@tcp:101:cat.0 00010000:00010000:0.0:1788625268.263442:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625268.263467:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f6843b7/0x2d2e3b3f34a7b389 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e43b expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625268.263496:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9c416f, atime: 0x6a9c416e, ctime: 0x6a9c416f, blocks: 0x8 00010000:00010000:0.0:1788625268.263573:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=389s v=(0 0) 00010000:00010000:0.0:1788625268.263579:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625268.263594:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f6843b7/0x2d2e3b3f34a7b389 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e43b expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625268.263615:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f6843b7/0x2d2e3b3f34a7b389 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e43b expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625268.263629:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae1a00, rc 0) 00000100:00100000:0.0:1788625268.263699:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2393:x1875509185194752:12345-192.168.204.14@tcp:101:cat.0 Request processed in 286us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625268.263707:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 79 00000100:00100000:2.0:1788625268.270275:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625268.270482:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185194880 00000100:00100000:1.0:1788625268.270497:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185194880 00002000:00100000:1.0:1788625268.270656:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff998744833480 x1875509185194880/t0(0) o3->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:79/0 lens 488/0 e 0 to 0 dl 1788625279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625268.270672:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998744833480 with x1875509185194880 ext(0->4095) 00002000:00010000:1.0:1788625268.270681:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff998744833480 00000100:00100000:1.0:1788625268.270724:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:1.0:1788625268.270737:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2392:x1875509185194880:12345-192.168.204.14@tcp:3:cat.0 00000100:00100000:1.0:1788625268.271010:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+8:2392:x1875509185194880:12345-192.168.204.14@tcp:3:cat.0 Request processed in 275us (752us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788625268.271020:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 7 00002000:00100000:1.0:1788625268.271027:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff998744833480 x1875509185194880/t0(0) o3->1338b3dc-3f02-4b26-a9aa-7a14f6033224@192.168.204.14@tcp:79/0 lens 488/4536 e 0 to 0 dl 1788625279 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788625268.271036:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998744833480 with x1875509185194880 ext(0->4095) 00002000:00010000:1.0:1788625268.271039:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff998744833480 00000100:00100000:2.0:1788625268.492966:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625268.492998:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206208256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625268.493119:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625268.493289:0:14517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206208256 00000100:00100000:3.0:1788625268.493301:0:14517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206208256 00000100:00100000:3.0:1788625268.493365:0:14517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788625268.493376:0:14517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206208256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788625268.493419:0:14517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788625268.493503:0:14517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206208256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625268.493576:0:14517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788625268.493857:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206208256:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788625268.811927:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625269.012436:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206208384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625269.012570:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625269.012720:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206208512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625269.012754:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625269.012787:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206208384 00000100:00100000:1.0:1788625269.012795:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206208384 00000100:00100000:1.0:1788625269.012859:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206208512 00000100:00100000:1.0:1788625269.012862:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206208512 00000100:00100000:1.0:1788625269.012883:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788625269.012891:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206208384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788625269.012929:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625269.012975:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206208384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625269.012981:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788625269.012996:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788625269.013003:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875509206208512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625269.013012:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625269.013047:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875509206208512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625269.013053:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1788625269.013100:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625269.019125:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206208384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625269.019250:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206208512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625269.517732:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206208640:0@lo:400:kworker.0 00000100:00100000:1.0:1788625269.517806:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625269.517863:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206209152:0@lo:400:kworker.0 00000100:00100000:1.0:1788625269.517890:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625269.517910:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206209664:0@lo:400:kworker.0 00000100:00100000:1.0:1788625269.517953:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625269.517976:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788625269.517983:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206209024:0@lo:400:kworker.0 00000100:00100000:1.0:1788625269.518006:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625269.518026:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206209536:0@lo:400:kworker.0 00000100:00100000:1.0:1788625269.518049:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625269.518085:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206208768:0@lo:400:kworker.0 00000100:00100000:1.0:1788625269.518110:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625269.518115:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206208640 00000100:00100000:2.0:1788625269.518125:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206208640 00000100:00100000:1.0:1788625269.518131:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206209280:0@lo:400:kworker.0 00000100:00100000:1.0:1788625269.518156:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625269.518174:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206209792:0@lo:400:kworker.0 00000100:00100000:1.0:1788625269.518197:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625269.518216:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788625269.518344:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206209664 00000100:00100000:3.0:1788625269.518349:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206209664 00000100:00100000:3.0:1788625269.518383:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206209024 00000100:00100000:3.0:1788625269.518386:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206209024 00000100:00100000:3.0:1788625269.518397:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206209536 00000100:00100000:3.0:1788625269.518400:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206209536 00000100:00100000:3.0:1788625269.518411:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206208768 00000100:00100000:3.0:1788625269.518414:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206208768 00000100:00100000:3.0:1788625269.518423:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206209280 00000100:00100000:3.0:1788625269.518426:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206209280 00000100:00100000:3.0:1788625269.518442:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788625269.518450:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206209664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625269.518489:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788625269.518500:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206208640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625269.518510:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206209664:12345-0@lo:400:kworker.0 Request processed in 59us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625269.518539:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788625269.518560:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788625269.518567:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206209024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625269.518870:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206208896:0@lo:400:kworker.0 00000100:00100000:3.0:1788625269.518922:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206209024:12345-0@lo:400:kworker.0 Request processed in 355us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625269.518930:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788625269.518944:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788625269.518950:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206209536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625269.518979:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206209536:12345-0@lo:400:kworker.0 Request processed in 30us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625269.518985:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788625269.519009:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788625269.519015:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206208768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625269.519043:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206208768:12345-0@lo:400:kworker.0 Request processed in 29us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625269.519049:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788625269.519073:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788625269.519080:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206209280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625269.519107:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206209280:12345-0@lo:400:kworker.0 Request processed in 28us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625269.519113:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00080000:3.0:1788625269.519139:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625269.519143:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625269.519169:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206209024:0@lo:400:kworker.0 00000100:00100000:3.0:1788625269.519181:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206209536:0@lo:400:kworker.0 00010000:00080000:3.0:1788625269.519193:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998858355f80 x1875509206209664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625269.519203:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206209664:0@lo:400:kworker.0 00000100:00100000:0.0:1788625269.519621:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206209152 00000100:00100000:0.0:1788625269.519628:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206209152 00000100:00100000:0.0:1788625269.519766:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788625269.519774:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206209152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625269.519821:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206209152:12345-0@lo:400:kworker.0 Request processed in 48us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625269.519828:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788625269.519955:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206209152:0@lo:400:kworker.0 00000100:00100000:2.0:1788625269.520179:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3638:x1875509206208640:12345-0@lo:400:kworker.0 Request processed in 1671us (2362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625269.520188:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788625269.520438:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206208640:0@lo:400:kworker.0 00000100:00100000:2.0:1788625269.520639:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206209792 00000100:00100000:2.0:1788625269.520645:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206209792 00000100:00100000:2.0:1788625269.520689:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788625269.520697:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206209792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625269.520739:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206209792:12345-0@lo:400:kworker.0 Request processed in 44us (2541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625269.520745:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1788625269.520928:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625269.523559:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625269.523625:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206209408:0@lo:400:kworker.0 00000100:00100000:3.0:1788625269.523652:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206208896 00000100:00100000:3.0:1788625269.523663:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206208896 00000100:00100000:1.0:1788625269.523674:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625269.523715:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206209920:0@lo:400:kworker.0 00000100:00100000:3.0:1788625269.523727:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788625269.523740:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206208896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625269.523767:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625269.523812:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206208768:0@lo:400:kworker.0 00000100:00100000:1.0:1788625269.523834:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206209280:0@lo:400:kworker.0 00000100:00100000:3.0:1788625269.523839:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206208896:12345-0@lo:400:kworker.0 Request processed in 100us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625269.523848:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788625269.523855:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206209792:0@lo:400:kworker.0 00000100:00100000:1.0:1788625269.523886:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206208896:0@lo:400:kworker.0 00000100:00100000:1.0:1788625269.523906:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206209920 00000100:00100000:1.0:1788625269.523910:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206209920 00000100:00100000:2.0:1788625269.523936:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206209408 00000100:00100000:2.0:1788625269.523947:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206209408 00000100:00100000:1.0:1788625269.523961:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788625269.523971:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1875509206209920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625269.523988:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788625269.523997:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206209408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625269.524013:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1875509206209920:12345-0@lo:400:kworker.0 Request processed in 43us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625269.524021:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788625269.524042:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206209408:12345-0@lo:400:kworker.0 Request processed in 46us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625269.524049:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00010000:00080000:1.0:1788625269.524057:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998858354700 x1875509206209408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625269.524080:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206209408:0@lo:400:kworker.0 00000100:00100000:1.0:1788625269.524093:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206209920:0@lo:400:kworker.0 00000100:00080000:3.0:1788625269.525388:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625269.525395:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788625269.837669:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625270.028834:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206210048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625270.028916:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625270.029084:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206210048 00000100:00100000:0.0:1788625270.029092:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206210048 00000100:00100000:0.0:1788625270.029153:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788625270.029163:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875509206210048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625270.029192:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788625270.029253:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875509206210048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625270.029260:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788625270.029389:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206210048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625270.030365:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625270.030379:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206210176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625270.030429:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625270.030471:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206210176 00000100:00100000:2.0:1788625270.030476:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206210176 00000100:00100000:2.0:1788625270.030511:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788625270.030535:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cdae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206210176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625270.030552:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788625270.030593:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cdae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206210176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625270.030599:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788625270.030843:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206210176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625270.030961:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625270.030971:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206210304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625270.031066:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625270.031101:0:14517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206210304 00000100:00100000:3.0:1788625270.031105:0:14517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206210304 00000100:00100000:3.0:1788625270.031146:0:14517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788625270.031153:0:14517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206210304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788625270.031179:0:14517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788625270.031218:0:14517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206210304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625270.031224:0:14517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788625270.031576:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206210304:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1788625270.037583:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1788625270.859897:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625271.052909:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788625271.052919:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788625271.052940:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788625271.052948:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1788625271.054071:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:0.0:1788625271.054084:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1788625271.059112:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1788625271.059146:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff998743861480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788625271.059152:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9988738e1200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff998743861180 00000020:00080000:2.0:1788625271.059156:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9988738e1600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff998742d39200 00000020:00080000:2.0:1788625271.059181:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1788625271.059273:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788625271.059350:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1788625271.059650:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b304 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625271.059665:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b304 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625271.059681:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b304 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625271.059688:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625271.059694:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b304 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625271.059705:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b304 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625271.059730:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9988625be400) 00010000:00010000:0.0:1788625271.059733:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625271.059739:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b304 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625271.059747:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188a00/0x2d2e3b3f34a7b304 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625271.815160:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625271.815202:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625271.815229:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625271.815257:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625271.815275:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625271.815293:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625271.815336:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625271.815369:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185195520 00000100:00100000:1.0:1788625271.815378:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185195520 00000100:00100000:1.0:1788625271.815427:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185195392 00000100:00100000:1.0:1788625271.815430:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185195392 00000100:00100000:1.0:1788625271.815451:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 134 00000100:00100000:1.0:1788625271.815462:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2394:x1875509185195520:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625271.815542:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2394:x1875509185195520:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 82us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625271.815550:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 134 00000100:00100000:1.0:1788625271.815566:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 135 00000100:00100000:1.0:1788625271.815573:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185195392:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625271.815594:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185195392:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 22us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625271.815600:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 135 00000100:00100000:3.0:1788625271.815758:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185195008 00000100:00100000:3.0:1788625271.815762:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185195008 00000100:00100000:3.0:1788625271.815835:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 391 00000100:00100000:3.0:1788625271.815843:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2394:x1875509185195008:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625271.815876:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2394:x1875509185195008:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 34us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625271.815883:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 391 00000100:00080000:3.0:1788625271.815908:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625271.815912:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625271.816053:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185195264 00000100:00100000:2.0:1788625271.816058:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185195264 00000100:00100000:2.0:1788625271.816107:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185195776 00000100:00100000:2.0:1788625271.816117:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185195776 00000100:00100000:2.0:1788625271.816136:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185195136 00000100:00100000:2.0:1788625271.816149:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185195136 00000100:00100000:2.0:1788625271.816163:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185195648 00000100:00100000:2.0:1788625271.816167:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185195648 00000100:00100000:2.0:1788625271.816182:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 332 00000100:00100000:2.0:1788625271.816189:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185195264:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625271.816218:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2394:x1875509185195264:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 30us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625271.816223:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 332 00000100:00100000:2.0:1788625271.816236:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 333 00000100:00100000:2.0:1788625271.816242:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185195776:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625271.816262:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185195776:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 21us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625271.816268:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 333 00000100:00100000:2.0:1788625271.816279:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 334 00000100:00100000:2.0:1788625271.816285:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:2394:x1875509185195136:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625271.816311:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:2394:x1875509185195136:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 25us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625271.816318:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 334 00000100:00100000:2.0:1788625271.816328:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 335 00000100:00100000:2.0:1788625271.816334:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185195648:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625271.816354:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185195648:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 21us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625271.816366:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 335 00000100:00080000:3.0:1788625271.816801:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625271.816806:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788625271.883843:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625272.012250:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788625272.908006:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625273.170502:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625273.170830:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185195904 00000100:00100000:0.0:1788625273.170845:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185195904 00000100:00100000:0.0:1788625273.171021:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 255 00000100:00100000:0.0:1788625273.171036:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:12165:x1875509185195904:12345-192.168.204.14@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788625273.171183:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:12165:x1875509185195904:12345-192.168.204.14@tcp:60:lhsmtool_posix.0 Request processed in 152us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625273.171192:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 255 00000100:00080000:3.0:1788625273.173398:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625273.182677:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625273.182813:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185196032 00000100:00100000:3.0:1788625273.182827:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185196032 00000100:00100000:3.0:1788625273.182944:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 256 00000100:00100000:3.0:1788625273.182957:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:12165:x1875509185196032:12345-192.168.204.14@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788625273.183266:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:12165:x1875509185196032:12345-192.168.204.14@tcp:60:lhsmtool_posix.0 Request processed in 312us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625273.183275:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 256 00000100:00080000:0.0:1788625273.183356:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788625273.187708:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625273.188623:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185196288 00000100:00100000:0.0:1788625273.188660:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185196288 00000100:00100000:0.0:1788625273.188748:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:0.0:1788625273.188761:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:12165:x1875509185196288:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788625273.189095:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:12165:x1875509185196288:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 336us (1404us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788625273.189105:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:2.0:1788625273.478454:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625273.478553:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185196416 00000100:00100000:0.0:1788625273.478567:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185196416 00000100:00100000:0.0:1788625273.478671:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 257 00000100:00100000:0.0:1788625273.478683:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:12977:x1875509185196416:12345-192.168.204.14@tcp:101:lsof.0 00010000:00010000:0.0:1788625273.478711:0:11318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625273.478873:0:11318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b390 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e442 expref: -99 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788625273.478893:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788625273.479026:0:11318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7b397 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625273.479041:0:11318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7b397 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625273.479054:0:11318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7b397 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625273.479101:0:11318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788625273.479106:0:11318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625273.479128:0:11318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7b397 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625273.479160:0:11318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0400/0x2d2e3b3f34a7b390 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e442 expref: 7 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625273.479197:0:11318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7b397 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e442 expref: 6 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625273.479206:0:11318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:0.0:1788625273.479210:0:11318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625273.479213:0:11318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae0200, rc 0) 00000100:00100000:0.0:1788625273.479378:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:12977:x1875509185196416:12345-192.168.204.14@tcp:101:lsof.0 Request processed in 696us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625273.479388:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 257 00000100:00100000:2.0:1788625273.613190:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625273.613215:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206210432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625273.613303:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625273.613478:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206210432 00000100:00100000:3.0:1788625273.613495:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206210432 00000100:00100000:3.0:1788625273.613669:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788625273.613682:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206210432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788625273.613743:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788625273.616574:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206210432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2885us (3260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625273.616589:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788625273.617129:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206210432:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788625273.933377:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625274.125949:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625274.125991:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206210560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625274.126087:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625274.126089:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625274.126114:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206210688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625274.126248:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625274.129555:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206210560 00000100:00100000:1.0:1788625274.129572:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206210560 00000100:00100000:3.0:1788625274.129599:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206210688 00000100:00080000:0.0:1788625274.129653:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625274.129727:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788625274.129751:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206210560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625274.129798:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625274.130044:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206210560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 305us (3959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625274.130066:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788625274.130291:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788625274.130299:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1788625274.130329:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff998744831880, transno 4294967311 00000100:00100000:1.0:1788625274.130364:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206210560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625274.130835:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206210688 00000100:00100000:3.0:1788625274.131037:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788625274.131060:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206210688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788625274.131080:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788625274.131156:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206210688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (4910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625274.131163:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788625274.131315:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206210688:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788625274.131398:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625274.640090:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625274.640122:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206210816:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.640251:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625274.640351:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206210816 00000100:00100000:2.0:1788625274.640362:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206210816 00000100:00100000:2.0:1788625274.640436:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1788625274.640447:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206210816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.640562:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3636:x1875509206210816:12345-0@lo:400:kworker.0 Request processed in 71us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625274.640594:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1788625274.640671:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206210816:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.640722:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206210944:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.640753:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625274.640785:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206210944 00000100:00100000:2.0:1788625274.640788:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206210944 00000100:00100000:2.0:1788625274.640820:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788625274.640827:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206210944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.640864:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206210944:12345-0@lo:400:kworker.0 Request processed in 38us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625274.640871:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788625274.640900:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206210944:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.640939:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206211072:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.640980:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625274.641013:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206211072 00000100:00100000:2.0:1788625274.641017:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206211072 00000100:00100000:2.0:1788625274.641046:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788625274.641053:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206211072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.641092:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206211072:12345-0@lo:400:kworker.0 Request processed in 40us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625274.641099:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788625274.641122:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206211072:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.641150:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625274.641157:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206211200:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.641190:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625274.641217:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206211200 00000100:00100000:2.0:1788625274.641222:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206211200 00000100:00100000:2.0:1788625274.641247:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788625274.641253:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206211200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.641287:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206211200:12345-0@lo:400:kworker.0 Request processed in 34us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625274.641293:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788625274.641320:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206211200:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.641348:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625274.641354:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206211328:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.641378:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625274.641416:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206211456:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.641436:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625274.641477:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206211584:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.641499:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625274.641550:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206211456 00000100:00100000:2.0:1788625274.641554:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206211456 00000100:00100000:3.0:1788625274.641585:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206211328 00000100:00100000:2.0:1788625274.641592:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206211584 00000100:00100000:3.0:1788625274.641593:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206211328 00000100:00100000:2.0:1788625274.641598:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206211584 00000100:00100000:2.0:1788625274.641617:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788625274.641624:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206211456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.641657:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206211456:12345-0@lo:400:kworker.0 Request processed in 34us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625274.641664:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788625274.641677:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788625274.641683:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788625274.641688:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206211328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.641704:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206211584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625274.641744:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206211328:12345-0@lo:400:kworker.0 Request processed in 58us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625274.641752:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788625274.641757:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206211584:12345-0@lo:400:kworker.0 Request processed in 55us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625274.641766:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788625274.641990:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206211456:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.642002:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206211328:0@lo:400:kworker.0 00010000:00080000:2.0:1788625274.642031:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9988449ac000 x1875509206211584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625274.642042:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206211584:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.642252:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206211968:0@lo:400:kworker.0 00000100:00100000:3.0:1788625274.642268:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206212096:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.642292:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788625274.643884:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788625274.643897:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625274.652042:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206211712:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.652138:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625274.652149:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206211840:0@lo:400:kworker.0 00000100:00100000:0.0:1788625274.652161:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625274.652210:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206211712 00000100:00100000:2.0:1788625274.652223:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206211712 00000100:00100000:2.0:1788625274.652311:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788625274.652322:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206211712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625274.654030:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625274.659018:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206211712:12345-0@lo:400:kworker.0 Request processed in 6681us (6839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625274.659040:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788625274.659106:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625274.665051:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206211968 00000100:00100000:1.0:1788625274.665074:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206211968 00000100:00100000:1.0:1788625274.665260:0:8868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206212096 00000100:00100000:1.0:1788625274.665265:0:8868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206212096 00000100:00100000:1.0:1788625274.665332:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788625274.665345:0:8868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206211968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.665965:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206211840 00000100:00100000:2.0:1788625274.665973:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206211840 00000100:00100000:2.0:1788625274.666018:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788625274.666026:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206211840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.666102:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206211840:12345-0@lo:400:kworker.0 Request processed in 77us (6996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625274.666110:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00010000:00080000:2.0:1788625274.666472:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99874483b800 x1875509206211840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625274.666490:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206211840:0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.666579:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788625274.666591:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206212096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625274.666634:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206212096:12345-0@lo:400:kworker.0 Request processed in 46us (12614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625274.666641:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788625274.666739:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206211712:0@lo:400:kworker.0 00000100:00080000:0.0:1788625274.666766:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788625274.666772:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625274.666774:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625274.672543:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1788625274.672612:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff998744829500, transno 4294967323 00000004:00080000:3.0:1788625274.672708:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1788625274.672748:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206212096:0@lo:400:kworker.0 00000100:00100000:1.0:1788625274.676156:0:8868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206211968:12345-0@lo:400:kworker.0 Request processed in 10799us (33850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625274.676177:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788625274.681219:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206211968:0@lo:400:kworker.0 00010000:00010000:0.0:1788625274.956725:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625275.148206:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206212352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625275.148325:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625275.148425:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206212224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625275.148457:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625275.148473:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206212352 00000100:00100000:0.0:1788625275.148485:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206212352 00000100:00100000:3.0:1788625275.148501:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206212224 00000100:00100000:3.0:1788625275.148540:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206212224 00000100:00100000:3.0:1788625275.148587:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788625275.148597:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206212224:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625275.148631:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206212480:0@lo:13:osp-pre-1-1.0 00000004:00000024:3.0:1788625275.148643:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788625275.148663:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625275.148694:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206212224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625275.148702:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788625275.148730:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206212480 00000100:00100000:2.0:1788625275.148734:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206212480 00000100:00100000:3.0:1788625275.148869:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206212224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625275.152917:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788625275.152964:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206212352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625275.153018:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788625275.153174:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206212352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 243us (4850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625275.153182:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788625275.154435:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206212352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625275.155366:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788625275.155394:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206212480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625275.155430:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788625275.155565:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206212480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 172us (6886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625275.155572:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788625275.156794:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206212480:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788625275.981209:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788625276.694475:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1788625276.694498:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788625276.694655:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788625276.694672:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1788625276.935579:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625276.935620:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625276.935657:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625276.935678:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625276.935695:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625276.935711:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625276.935736:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625276.935841:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185196544 00000100:00100000:2.0:1788625276.935842:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185196800 00000100:00100000:3.0:1788625276.935853:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185196544 00000100:00100000:2.0:1788625276.935854:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185196800 00000100:00100000:3.0:1788625276.935924:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 393 00000100:00100000:3.0:1788625276.935935:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185196544:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625276.935944:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185197312 00000100:00100000:2.0:1788625276.935949:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185197312 00000100:00100000:2.0:1788625276.935967:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185196672 00000100:00100000:2.0:1788625276.935970:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185196672 00000100:00100000:2.0:1788625276.935984:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185197184 00000100:00100000:2.0:1788625276.935986:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185197184 00000100:00100000:3.0:1788625276.936003:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2393:x1875509185196544:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 70us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625276.936008:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 342 00000100:00100000:3.0:1788625276.936016:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 393 00000100:00100000:2.0:1788625276.936022:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185196800:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625276.936060:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185196800:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 42us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625276.936066:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 342 00000100:00100000:2.0:1788625276.936085:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 343 00000100:00100000:2.0:1788625276.936092:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185197312:12345-192.168.204.14@tcp:400:kworker.0 00000100:00080000:1.0:1788625276.936140:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625276.936144:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625276.938042:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 344 00000100:00100000:0.0:1788625276.938060:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:2393:x1875509185196672:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625276.941052:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 345 00000100:00100000:1.0:1788625276.941080:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2393:x1875509185197184:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625276.942359:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2393:x1875509185197312:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 6257us (6669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625276.942372:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 343 00000100:00100000:0.0:1788625276.943484:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:2393:x1875509185196672:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 5423us (7780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625276.943498:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 344 00000100:00100000:0.0:1788625276.943560:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185197056 00000100:00100000:0.0:1788625276.943569:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185197056 00000100:00100000:0.0:1788625276.943629:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185196928 00000100:00100000:0.0:1788625276.943633:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185196928 00000100:00100000:0.0:1788625276.943658:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 138 00000100:00100000:0.0:1788625276.943666:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185197056:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625276.943727:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2393:x1875509185197056:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 61us (8069us total) trans 0 rc 0/0 00000100:00080000:2.0:1788625276.943732:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625276.943738:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 138 00000100:00080000:2.0:1788625276.943740:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625276.943755:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 139 00000100:00100000:0.0:1788625276.943762:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185196928:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625276.943787:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2393:x1875509185196928:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 25us (8074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625276.943793:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 139 00000100:00100000:1.0:1788625276.950433:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2393:x1875509185197184:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 9352us (14681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625276.950453:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 345 00010000:00010000:0.0:1788625277.007715:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788625277.319784:0:15053:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:21:14 (1788625274) 00010000:00010000:0.0:1788625278.028765:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625278.732727:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625278.732762:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206212608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625278.732855:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625278.733749:0:14517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206212608 00000100:00100000:0.0:1788625278.733760:0:14517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206212608 00000100:00100000:0.0:1788625278.733821:0:14517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788625278.733832:0:14517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206212608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625278.733885:0:14517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788625278.734722:0:14517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206212608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 886us (1862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625278.734732:0:14517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788625278.734866:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206212608:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788625279.058142:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625279.247324:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206212736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625279.247406:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625279.247575:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206212736 00000100:00100000:1.0:1788625279.247586:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206212736 00000100:00100000:1.0:1788625279.247649:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788625279.247662:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206212736:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788625279.247665:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788625279.247709:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625279.247761:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206212736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625279.247768:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788625279.247814:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206212736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788625279.250180:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625279.250210:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206212864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625279.250297:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625279.250408:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206212864 00000100:00100000:1.0:1788625279.250417:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206212864 00000100:00100000:1.0:1788625279.250485:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788625279.250496:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206212864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625279.250544:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788625279.250602:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206212864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625279.250611:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788625279.250675:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206212864:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788625279.253371:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625279.756279:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206213376:0@lo:400:kworker.0 00000100:00100000:1.0:1788625279.756283:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206212992:0@lo:400:kworker.0 00000100:00100000:0.0:1788625279.756372:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206213248:0@lo:400:kworker.0 00000100:00100000:2.0:1788625279.756428:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206213120:0@lo:400:kworker.0 00000100:00100000:3.0:1788625279.757152:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625279.757216:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206213888:0@lo:400:kworker.0 00000100:00100000:3.0:1788625279.757244:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625279.757307:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206213376 00000100:00100000:3.0:1788625279.757314:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206213376 00000100:00100000:3.0:1788625279.757362:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206213888 00000100:00100000:3.0:1788625279.757365:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206213888 00000100:00100000:3.0:1788625279.757395:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788625279.757403:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206213376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625279.757462:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206213376:12345-0@lo:400:kworker.0 Request processed in 59us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625279.757469:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788625279.757485:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788625279.757491:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206213888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625279.757540:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206213888:12345-0@lo:400:kworker.0 Request processed in 49us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625279.757547:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00080000:3.0:1788625279.757564:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625279.757592:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206213376:0@lo:400:kworker.0 00000100:00100000:3.0:1788625279.757602:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206213888:0@lo:400:kworker.0 00000100:00100000:3.0:1788625279.761294:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625279.761370:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206213504:0@lo:400:kworker.0 00000100:00100000:3.0:1788625279.761413:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625279.761445:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206213504 00000100:00100000:3.0:1788625279.761453:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206213504 00000100:00100000:3.0:1788625279.761506:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788625279.761550:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206213504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625279.761611:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206213504:12345-0@lo:400:kworker.0 Request processed in 64us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625279.761618:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788625279.761660:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206213504:0@lo:400:kworker.0 00000100:00100000:3.0:1788625279.761668:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206214016:0@lo:400:kworker.0 00000100:00100000:3.0:1788625279.761696:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625279.762224:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206212992 00000100:00100000:1.0:1788625279.762230:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206212992 00000100:00100000:1.0:1788625279.762276:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788625279.762284:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206212992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625279.762328:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206212992:12345-0@lo:400:kworker.0 Request processed in 46us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625279.762335:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788625279.762364:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206214016 00000100:00100000:1.0:1788625279.762376:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206214016 00000100:00100000:1.0:1788625279.762670:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788625279.762680:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206214016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625279.762716:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206214016:12345-0@lo:400:kworker.0 Request processed in 39us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625279.762723:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788625279.762879:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206212992:0@lo:400:kworker.0 00010000:00080000:3.0:1788625279.762896:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998858355c00 x1875509206214016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625279.762909:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206214016:0@lo:400:kworker.0 00000100:00080000:3.0:1788625279.762956:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625279.767428:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625279.767497:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206213760:0@lo:400:kworker.0 00000100:00100000:0.0:1788625279.767545:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625279.767588:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206213760 00000100:00100000:0.0:1788625279.767595:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206213760 00000100:00100000:0.0:1788625279.767653:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788625279.767662:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206213760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625279.767713:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206213760:12345-0@lo:400:kworker.0 Request processed in 52us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625279.767720:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00080000:0.0:1788625279.767747:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788625279.767781:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99874483ad80 x1875509206213760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625279.767797:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206213760:0@lo:400:kworker.0 00000100:00100000:0.0:1788625279.767805:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206214272:0@lo:400:kworker.0 00000100:00100000:0.0:1788625279.767851:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625279.767891:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206214272 00000100:00100000:0.0:1788625279.767895:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206214272 00000100:00100000:0.0:1788625279.767944:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788625279.767951:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206214272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625279.767996:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206214272:12345-0@lo:400:kworker.0 Request processed in 45us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625279.768003:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1788625279.768023:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625279.768051:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206214272:0@lo:400:kworker.0 00000100:00100000:3.0:1788625279.768446:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206213248 00000100:00100000:3.0:1788625279.768451:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206213248 00000100:00100000:3.0:1788625279.768491:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788625279.768498:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206213248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625279.768572:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206213248:12345-0@lo:400:kworker.0 Request processed in 75us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625279.768580:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788625279.768651:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206213248:0@lo:400:kworker.0 00000100:00100000:2.0:1788625279.769809:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625279.769913:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206213632:0@lo:400:kworker.0 00000100:00100000:2.0:1788625279.769952:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625279.770285:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206214144:0@lo:400:kworker.0 00000100:00100000:2.0:1788625279.770316:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625279.770421:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206214144 00000100:00100000:1.0:1788625279.770428:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206214144 00000100:00100000:1.0:1788625279.770489:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788625279.770498:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206214144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625279.770574:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206214144:12345-0@lo:400:kworker.0 Request processed in 78us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625279.770581:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1788625279.770645:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625279.770688:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206214144:0@lo:400:kworker.0 00000100:00100000:3.0:1788625279.770797:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206213120 00000100:00100000:3.0:1788625279.770802:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206213120 00000100:00100000:3.0:1788625279.770838:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206213632 00000100:00100000:3.0:1788625279.770842:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206213632 00000100:00100000:3.0:1788625279.770885:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788625279.770892:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206213120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625279.770956:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206213120:12345-0@lo:400:kworker.0 Request processed in 64us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625279.770963:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00080000:2.0:1788625279.771217:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625279.771240:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206213120:0@lo:400:kworker.0 00000100:00100000:1.0:1788625279.771310:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788625279.771320:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206213632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625279.771402:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206213632:12345-0@lo:400:kworker.0 Request processed in 85us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625279.771408:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788625279.771510:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206213632:0@lo:400:kworker.0 00010000:00010000:0.0:1788625280.075786:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625280.267829:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625280.267863:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206214400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625280.267942:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625280.268065:0:14517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206214400 00000100:00100000:3.0:1788625280.268074:0:14517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206214400 00000100:00100000:3.0:1788625280.268132:0:14517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788625280.268142:0:14517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206214400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788625280.268173:0:14517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788625280.268226:0:14517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206214400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625280.268233:0:14517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788625280.268278:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206214400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625280.268693:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206214656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625280.268728:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625280.268765:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625280.268771:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206214528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625280.268795:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625280.268824:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206214656 00000100:00100000:2.0:1788625280.268828:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206214656 00000100:00100000:2.0:1788625280.268866:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206214528 00000100:00100000:2.0:1788625280.268869:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206214528 00000100:00100000:2.0:1788625280.268883:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788625280.268890:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206214656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625280.268911:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788625280.268947:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206214656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625280.268953:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788625280.268968:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788625280.268974:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206214528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788625280.268984:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788625280.269006:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206214528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625280.269013:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788625280.269057:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206214528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625280.269070:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206214656:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788625281.099767:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625281.292162:0:13790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788625281.292173:0:13790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788625281.292314:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788625281.292322:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788625281.709422:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625281.709683:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185197568 00000100:00100000:1.0:1788625281.709696:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185197568 00000100:00080000:2.0:1788625281.709790:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625281.709797:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 66 00000100:00100000:1.0:1788625281.709830:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+18:13201:x1875509185197568:12345-192.168.204.14@tcp:35:umount.0 00000100:00100000:1.0:1788625281.711919:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:13201:x1875509185197568:12345-192.168.204.14@tcp:35:umount.0 Request processed in 2101us (2497us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788625281.711933:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 66 00000100:00100000:2.0:1788625281.723988:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625281.724150:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185197824 00000100:00100000:3.0:1788625281.724164:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185197824 00000100:00100000:3.0:1788625281.724240:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 67 00000100:00100000:3.0:1788625281.724252:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+19:13201:x1875509185197824:12345-192.168.204.14@tcp:35:umount.0 00000100:00100000:3.0:1788625281.725361:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+20:13201:x1875509185197824:12345-192.168.204.14@tcp:35:umount.0 Request processed in 1106us (1379us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788625281.725371:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 67 00000100:00100000:0.0:1788625281.730282:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625281.730452:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185198080 00000100:00100000:1.0:1788625281.730465:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185198080 00000100:00100000:1.0:1788625281.730653:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 68 00000100:00100000:1.0:1788625281.730666:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866f54850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+20:13201:x1875509185198080:12345-192.168.204.14@tcp:35:umount.0 00000100:00100000:1.0:1788625281.732240:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866f54850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:13201:x1875509185198080:12345-192.168.204.14@tcp:35:umount.0 Request processed in 1567us (1962us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788625281.732252:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 68 00000100:00100000:2.0:1788625281.739225:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625281.739309:0:12000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185198336 00000100:00100000:3.0:1788625281.739319:0:12000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185198336 00000100:00100000:3.0:1788625281.739417:0:12000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 69 00000100:00100000:3.0:1788625281.739428:0:12000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+21:13201:x1875509185198336:12345-192.168.204.14@tcp:35:umount.0 00000100:00100000:3.0:1788625281.739761:0:12000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:13201:x1875509185198336:12345-192.168.204.14@tcp:35:umount.0 Request processed in 334us (547us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788625281.739787:0:12000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 69 00000100:00100000:2.0:1788625281.745375:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625281.745416:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625281.746768:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625281.749032:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625281.749078:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185198976 00000100:00100000:2.0:1788625281.749087:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185198976 00000100:00100000:2.0:1788625281.749144:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 80 00000100:00100000:2.0:1788625281.749155:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2390:x1875509185198976:12345-192.168.204.14@tcp:9:umount.0 00000020:00000080:2.0:1788625281.749186:0:8425:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a8fb 00000020:00010000:2.0:1788625281.749194:0:8425:0:(genops.c:1921:obd_stale_export_put()) Put export ffff998744148000: total 0 00000100:00080000:2.0:1788625281.749198:0:8425:0:(import.c:65:import_set_state_nolock()) ffff998744149800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788625281.749243:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788625281.749705:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2390:x1875509185198976:12345-192.168.204.14@tcp:9:umount.0 Request processed in 549us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625281.749713:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 80 00000100:00080000:2.0:1788625281.749735:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:2.0:1788625281.749755:0:6500:0:(genops.c:1907:obd_stale_export_get()) Get export ffff998744148000: total 0 00010000:00010000:2.0:1788625281.749780:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff998744148000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788625281.749842:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dec43314/0x2d2e3b3f34a7acba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e258 expref: 4 pid: 8868 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.749911:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f6843b7/0x2d2e3b3f34a7b389 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e43b expref: 3 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.749925:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff998744148000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788625281.749938:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625281.749941:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625281.749943:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625281.751138:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185198464 00000100:00100000:1.0:1788625281.751150:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185198464 00000100:00100000:1.0:1788625281.751222:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185198592 00000100:00100000:1.0:1788625281.751226:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185198592 00000100:00100000:1.0:1788625281.751250:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185199104 00000100:00100000:1.0:1788625281.751254:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185199104 00000100:00100000:1.0:1788625281.751274:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:1.0:1788625281.751282:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+15:2391:x1875509185198464:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625281.751298:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625281.751313:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c995a00/0x2d2e3b3f34a7a36e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df95 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625281.751328:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625281.751437:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:2.0:1788625281.751448:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+14:2391:x1875509185198592:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625281.751456:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625281.751466:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882171a00/0x2d2e3b3f34a7a5c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e06e expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.751477:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625281.751582:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+13:2391:x1875509185198464:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 299us (6218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625281.751589:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:1.0:1788625281.751620:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 22 00000100:00100000:1.0:1788625281.751627:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+12:2392:x1875509185199104:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625281.751635:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625281.751644:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c994000/0x2d2e3b3f34a7a2b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df56 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625281.751654:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625281.754990:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:2391:x1875509185198592:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 3422us (9449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625281.755006:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:1.0:1788625281.755077:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2392:x1875509185199104:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 3449us (8315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625281.755085:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 22 00000100:00100000:2.0:1788625281.763255:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625281.763362:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185199232 00000100:00100000:1.0:1788625281.763374:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185199232 00000100:00100000:1.0:1788625281.763459:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 81 00000100:00100000:1.0:1788625281.763472:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2390:x1875509185199232:12345-192.168.204.14@tcp:9:umount.0 00000020:00000080:1.0:1788625281.763506:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a68c 00000100:00080000:1.0:1788625281.763828:0:8423:0:(import.c:65:import_set_state_nolock()) ffff998743af0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788625281.764049:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788625281.764231:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1338b3dc-3f02-4b26-a9aa-7a14f6033224+2:2390:x1875509185199232:12345-192.168.204.14@tcp:9:umount.0 Request processed in 761us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625281.764240:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 81 00000100:00080000:2.0:1788625281.765458:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788625281.765778:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625281.776185:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625281.777190:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185200256 00000100:00100000:0.0:1788625281.777202:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185200256 00000100:00100000:0.0:1788625281.777353:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 258 00000100:00100000:0.0:1788625281.777366:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+22:2390:x1875509185200256:12345-192.168.204.14@tcp:39:umount.0 00000020:00000080:0.0:1788625281.777410:0:6512:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a2bf 00000020:00010000:0.0:1788625281.777431:0:6512:0:(genops.c:1921:obd_stale_export_put()) Put export ffff998743520000: total 0 00000100:00080000:0.0:1788625281.777436:0:6512:0:(import.c:65:import_set_state_nolock()) ffff998743521800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788625281.777477:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:2.0:1788625281.777702:0:10330:0:(genops.c:1907:obd_stale_export_get()) Get export ffff998743520000: total 0 00010000:00010000:2.0:1788625281.777763:0:10330:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff998743520000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788625281.777804:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:2.0:1788625281.777808:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625281.777827:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7b34a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e426 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.778237:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:2.0:1788625281.778241:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788625281.778246:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9400/0x2d2e3b3f34a7b374 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e434 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.778265:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625281.778267:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788625281.778271:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7a662 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e098 expref: 19 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.778284:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:2.0:1788625281.778287:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788625281.778290:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682200/0x2d2e3b3f34a7b02c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e354 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.778302:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:2.0:1788625281.778304:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625281.778308:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c995c00/0x2d2e3b3f34a7ad23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e274 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.778320:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625281.778322:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625281.778326:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744189800/0x2d2e3b3f34a7ac7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e243 expref: 16 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.778352:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9987410b7f00) 00010000:00010000:2.0:1788625281.778354:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625281.778366:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188400/0x2d2e3b3f34a7b26a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e3ee expref: 15 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.778390:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625281.778392:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788625281.778396:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887c994800/0x2d2e3b3f34a7aca5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e251 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.778413:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9988749c9500) 00010000:00010000:2.0:1788625281.778415:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788625281.778418:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac6000/0x2d2e3b3f34a7a95d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e171 expref: 13 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.778435:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998743548200) 00010000:00010000:2.0:1788625281.778437:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625281.778441:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887cac7400/0x2d2e3b3f34a7a607 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e083 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.778455:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9988749c3d00) 00010000:00010000:2.0:1788625281.778459:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625281.778462:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882170e00/0x2d2e3b3f34a7a5eb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e07c expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.778477:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9988749c9b00) 00010000:00010000:2.0:1788625281.778479:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788625281.778483:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7ad3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e27b expref: 10 pid: 9824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.778497:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9988625be300) 00010000:00010000:2.0:1788625281.778505:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625281.778510:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998744188800/0x2d2e3b3f34a7ab9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e20b expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625281.778574:0:10330:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff998743520000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788625281.778596:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625281.778599:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625281.778601:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625281.778959:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1338b3dc-3f02-4b26-a9aa-7a14f6033224+7:2390:x1875509185200256:12345-192.168.204.14@tcp:39:umount.0 Request processed in 1592us (2784us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788625281.778978:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 258 00000100:00100000:0.0:1788625281.798706:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625281.800079:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185200384 00000100:00100000:1.0:1788625281.800092:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185200384 00000100:00080000:3.0:1788625281.800241:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788625281.800415:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 259 00000100:00100000:1.0:1788625281.800430:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+5:2390:x1875509185200384:12345-192.168.204.14@tcp:39:umount.0 00000020:00000080:1.0:1788625281.800466:0:6513:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a2c6 00000100:00080000:1.0:1788625281.800485:0:6513:0:(import.c:65:import_set_state_nolock()) ffff99887b611000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788625281.800542:0:6513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788625281.800748:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1338b3dc-3f02-4b26-a9aa-7a14f6033224+3:2390:x1875509185200384:12345-192.168.204.14@tcp:39:umount.0 Request processed in 323us (2051us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788625281.800757:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 259 00010000:00010000:2.0:1788625281.801243:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625282.044385:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625282.044450:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625282.044554:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185200512 00000100:00100000:1.0:1788625282.044574:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185200512 00000100:00100000:1.0:1788625282.044653:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185200640 00000100:00100000:1.0:1788625282.044656:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185200640 00000100:00100000:1.0:1788625282.044680:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 352 00000100:00100000:1.0:1788625282.044691:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2394:x1875509185200512:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625282.044765:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2394:x1875509185200512:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 76us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625282.044772:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 352 00000100:00100000:1.0:1788625282.044788:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 353 00000100:00100000:1.0:1788625282.044795:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185200640:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625282.044832:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2394:x1875509185200640:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 37us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625282.044838:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 353 00000100:00080000:3.0:1788625282.044905:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625282.044910:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788625282.123881:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788625282.252343:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788625283.148597:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625283.852028:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625283.852055:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206214784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625283.852153:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625283.852326:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206214784 00000100:00100000:0.0:1788625283.852335:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206214784 00000100:00100000:0.0:1788625283.852398:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788625283.852407:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206214784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625283.852445:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788625283.852500:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206214784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625283.852506:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788625283.852663:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206214784:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788625284.171874:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625284.366043:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625284.366064:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206214912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788625284.366142:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625284.366430:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206214912 00000100:00100000:2.0:1788625284.366437:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206214912 00000100:00100000:2.0:1788625284.366485:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788625284.366504:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206214912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788625284.366555:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625284.366604:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206214912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625284.366611:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1788625284.366645:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625284.366682:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206214912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625284.366700:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625284.366708:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206215040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625284.366731:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625284.366758:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206215040 00000100:00100000:2.0:1788625284.366784:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206215040 00000100:00100000:2.0:1788625284.366810:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788625284.366815:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206215040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625284.366828:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788625284.366863:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206215040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625284.366869:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1788625284.366880:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625284.366898:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206215040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625284.502660:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625284.502716:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625284.502845:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185200768 00000100:00100000:1.0:1788625284.502870:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185200768 00000100:00100000:1.0:1788625284.502937:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185200896 00000100:00100000:1.0:1788625284.502941:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185200896 00000100:00100000:1.0:1788625284.502971:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:1.0:1788625284.502981:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858356300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+11:2392:x1875509185200768:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625284.502994:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625284.503015:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7a3c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfaa expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625284.503032:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625284.503084:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858356300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+10:2392:x1875509185200768:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 106us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625284.503091:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:1.0:1788625284.503109:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:1.0:1788625284.503115:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+9:2392:x1875509185200896:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625284.503123:0:9513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625284.503131:0:9513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c995600/0x2d2e3b3f34a7a3c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3dfdb expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625284.503139:0:9513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625284.503158:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+8:2392:x1875509185200896:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 44us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625284.503164:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:0.0:1788625284.511887:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625284.511986:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185201024 00000100:00100000:1.0:1788625284.511996:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185201024 00000100:00100000:1.0:1788625284.512069:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:1.0:1788625284.512080:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+8:2394:x1875509185201024:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625284.512123:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625284.512145:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b683800/0x2d2e3b3f34a7a5ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e067 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625284.512165:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625284.512228:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+7:2394:x1875509185201024:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 150us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625284.512236:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:2.0:1788625284.522068:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625284.522159:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185201280 00000100:00100000:1.0:1788625284.522168:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185201280 00000100:00100000:1.0:1788625284.522245:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 260 00000100:00100000:1.0:1788625284.522255:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+6:2390:x1875509185201280:12345-192.168.204.14@tcp:39:umount.0 00000020:00000080:1.0:1788625284.522299:0:6513:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a3d7 00000020:00010000:1.0:1788625284.522307:0:6513:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9987438d3000: total 0 00000100:00080000:1.0:1788625284.522312:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9987438d2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788625284.522339:0:6513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1788625284.522495:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2390:x1875509185201280:12345-192.168.204.14@tcp:39:umount.0 Request processed in 241us (460us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1788625284.522503:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 260 00000020:00010000:0.0:1788625284.522741:0:6499:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9987438d3000: total 0 00010000:00010000:0.0:1788625284.522746:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625284.522822:0:6499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9987438d3000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788625284.522860:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c9100) 00010000:00010000:0.0:1788625284.522864:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625284.522873:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743ae0200/0x2d2e3b3f34a7b397 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e442 expref: 4 pid: 11318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625284.522897:0:6499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9987438d3000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788625284.522909:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625284.522911:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625284.522913:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788625284.523114:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625284.534976:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625284.535131:0:11318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185201408 00000100:00100000:0.0:1788625284.535141:0:11318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185201408 00000100:00100000:0.0:1788625284.535236:0:11318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 261 00000100:00100000:0.0:1788625284.535249:0:11318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:44e8506e-584d-40a5-8ecc-bc286c2e90c7+5:2390:x1875509185201408:12345-192.168.204.14@tcp:39:umount.0 00000020:00000080:0.0:1788625284.535308:0:11318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a3de 00000100:00080000:0.0:1788625284.535319:0:11318:0:(import.c:65:import_set_state_nolock()) ffff99874383c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788625284.535353:0:11318:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788625284.535541:0:11318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:44e8506e-584d-40a5-8ecc-bc286c2e90c7+3:2390:x1875509185201408:12345-192.168.204.14@tcp:39:umount.0 Request processed in 271us (552us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788625284.535550:0:11318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 261 00000100:00080000:2.0:1788625284.535820:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788625284.537011:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625284.668178:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625284.668321:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185201664 00000100:00100000:3.0:1788625284.668333:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185201664 00000100:00100000:3.0:1788625284.668397:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 395 00000100:00100000:3.0:1788625284.668409:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+7:2390:x1875509185201664:12345-192.168.204.14@tcp:251:umount.0 00000020:00000080:3.0:1788625284.668457:0:6506:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a29c 00000020:00010000:3.0:1788625284.668465:0:6506:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99885ee8c800: total 0 00000100:00080000:3.0:1788625284.668470:0:6506:0:(import.c:65:import_set_state_nolock()) ffff99885ee8d800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788625284.668614:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc+3:2390:x1875509185201664:12345-192.168.204.14@tcp:251:umount.0 Request processed in 208us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625284.668622:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 395 00000020:00010000:2.0:1788625284.669466:0:6500:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99885ee8c800: total 0 00010000:00010000:2.0:1788625284.669572:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99885ee8c800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788625284.669608:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be8200/0x2d2e3b3f34a7a375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3df9c expref: 2 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625284.669628:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99885ee8c800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788625284.669637:0:6500:0:(genops.c:885:class_export_put()) final put ffff99885ee8c800/e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc 00010000:00010000:2.0:1788625284.669651:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625284.669653:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625284.669654:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788625284.670055:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99885ee8c800/e7b6f1ab-a9f1-40ba-b2ff-da1648169cfc for MGS 00000020:00000080:3.0:1788625284.670101:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99885ee8d800 for MGS 00000100:00100000:3.0:1788625284.877848:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206215296:0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.877937:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625284.878002:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206215808:0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.878028:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625284.878044:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206216320:0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.878084:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625284.878113:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788625284.878119:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206215424:0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.878146:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625284.878162:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206215936:0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.878181:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625284.878198:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206216448:0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.878221:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625284.878265:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206215296 00000100:00100000:3.0:1788625284.878275:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206215296 00000100:00100000:3.0:1788625284.878324:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206215808 00000100:00100000:3.0:1788625284.878327:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206215808 00000100:00100000:3.0:1788625284.878377:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206215936 00000100:00100000:3.0:1788625284.878381:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206215936 00000100:00100000:3.0:1788625284.878402:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788625284.878415:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206215296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.878481:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206215296:12345-0@lo:400:kworker.0 Request processed in 69us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625284.878490:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788625284.878509:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788625284.878558:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206215808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.878591:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206215808:12345-0@lo:400:kworker.0 Request processed in 76us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625284.878597:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788625284.878609:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788625284.878617:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206215936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.878662:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206215936:12345-0@lo:400:kworker.0 Request processed in 47us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625284.878668:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788625284.878690:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206216320 00000100:00100000:3.0:1788625284.878694:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206216320 00000100:00100000:3.0:1788625284.878726:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206216448 00000100:00100000:3.0:1788625284.878729:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206216448 00000100:00100000:3.0:1788625284.878766:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788625284.878774:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206216320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.878809:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206216320:12345-0@lo:400:kworker.0 Request processed in 37us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625284.878815:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788625284.878827:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788625284.878833:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206216448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.878862:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206216448:12345-0@lo:400:kworker.0 Request processed in 29us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625284.878869:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1788625284.878889:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625284.878894:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625284.878896:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788625284.878940:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998858356300 x1875509206215936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625284.878956:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206215936:0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.878970:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206216448:0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.878980:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206215296:0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.879004:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206215808:0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.879013:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206216320:0@lo:400:kworker.0 00000100:00100000:1.0:1788625284.879128:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206215552:0@lo:400:kworker.0 00000100:00100000:1.0:1788625284.879167:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625284.879199:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206216064:0@lo:400:kworker.0 00000100:00100000:1.0:1788625284.879225:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625284.879257:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788625284.879264:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206215168:0@lo:400:kworker.0 00000100:00100000:1.0:1788625284.879295:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625284.879330:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206215680:0@lo:400:kworker.0 00000100:00100000:1.0:1788625284.879357:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625284.879375:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206216192:0@lo:400:kworker.0 00000100:00100000:1.0:1788625284.879400:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625284.879425:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206215424 00000100:00100000:1.0:1788625284.879430:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206215424 00000100:00100000:1.0:1788625284.879464:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206215680 00000100:00100000:1.0:1788625284.879468:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206215680 00000100:00100000:1.0:1788625284.879486:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788625284.879494:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206215424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625284.879572:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206215424:12345-0@lo:400:kworker.0 Request processed in 79us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625284.879579:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788625284.879593:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788625284.879599:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206215680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625284.879634:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206215680:12345-0@lo:400:kworker.0 Request processed in 35us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625284.879640:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788625284.879657:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206215552 00000100:00100000:1.0:1788625284.879662:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206215552 00000100:00100000:1.0:1788625284.879679:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206216064 00000100:00100000:1.0:1788625284.879682:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206216064 00000100:00100000:1.0:1788625284.879703:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206216192 00000100:00100000:1.0:1788625284.879705:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206216192 00000100:00100000:1.0:1788625284.879720:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788625284.879726:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206215552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625284.879765:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206215552:12345-0@lo:400:kworker.0 Request processed in 39us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625284.879780:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788625284.879792:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788625284.879798:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206216064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625284.879825:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206216064:12345-0@lo:400:kworker.0 Request processed in 28us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625284.879831:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788625284.879840:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788625284.879845:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206216192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625284.879866:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206216192:12345-0@lo:400:kworker.0 Request processed in 21us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625284.879871:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788625284.879893:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206215168 00000100:00100000:1.0:1788625284.879896:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206215168 00000100:00100000:1.0:1788625284.879920:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1788625284.879932:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988725f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206215168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625284.879958:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988725f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206215168:12345-0@lo:400:kworker.0 Request processed in 33us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625284.879964:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00080000:1.0:1788625284.879990:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625284.879993:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625284.880012:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206215168:0@lo:400:kworker.0 00000100:00100000:1.0:1788625284.880021:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206215680:0@lo:400:kworker.0 00010000:00080000:1.0:1788625284.880031:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998858354e00 x1875509206216192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625284.880051:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206216192:0@lo:400:kworker.0 00000100:00100000:1.0:1788625284.880062:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206215552:0@lo:400:kworker.0 00000100:00100000:1.0:1788625284.880070:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206216064:0@lo:400:kworker.0 00000100:00100000:3.0:1788625284.881890:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206215424:0@lo:400:kworker.0 00010000:00010000:0.0:1788625285.198083:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625285.388490:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625285.388565:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206216576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625285.388640:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625285.388778:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206216704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625285.388806:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625285.388841:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206216704 00000100:00100000:2.0:1788625285.388857:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206216704 00000100:00100000:2.0:1788625285.388905:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788625285.388915:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206216704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625285.388945:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788625285.388995:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206216704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625285.389003:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788625285.389054:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206216704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625285.389356:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206216832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625285.389401:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625285.389646:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206216832 00000100:00100000:3.0:1788625285.389652:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206216832 00000100:00100000:3.0:1788625285.389686:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788625285.389695:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206216832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788625285.389707:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788625285.389759:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206216832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625285.389766:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788625285.389804:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206216832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625285.391478:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206216576 00000100:00100000:1.0:1788625285.391491:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206216576 00000100:00100000:1.0:1788625285.391585:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788625285.391596:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206216576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625285.391647:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788625285.391755:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206216576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 161us (3115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625285.391762:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788625285.392405:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206216576:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788625286.219646:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788625286.773213:0:15249:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788625286.797800:0:15249:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788625286.797884:0:15249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a34b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.797904:0:15249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a34b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.797912:0:15249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a34b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.797920:0:15249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a34b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.797949:0:15249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788625286.797957:0:15249:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788625286.798025:0:15249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788625286.798031:0:15249:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788625286.798039:0:15249:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788625286.798078:0:15249:0:(import.c:65:import_set_state_nolock()) ffff99887b499800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788625286.798141:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625286.798150:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a34b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.798158:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682600 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625286.798162:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a34b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.798173:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7a34b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625286.798181:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7a34b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625286.798187:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788625286.798190:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788625286.798193:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788625286.798227:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a34b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.798246:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625286.798277:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a34b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.798285:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b682600/0x2d2e3b3f34a7a344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a34b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.798299:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625286.798300:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625286.798302:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625286.798312:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625286.798334:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206217088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625286.798425:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625286.798507:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206217088 00000100:00100000:2.0:1788625286.798555:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206217088 00000100:00100000:2.0:1788625286.798621:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788625286.798632:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3637:x1875509206217088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625286.798650:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625286.798670:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be9c00/0x2d2e3b3f34a7a34b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a344 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.798684:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625286.798740:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:3637:x1875509206217088:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625286.798749:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788625286.798798:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206217088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625286.799311:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206216960:0@lo:39:umount.0 00000100:00100000:3.0:1788625286.799386:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625286.800160:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206216960 00000100:00100000:1.0:1788625286.800172:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206216960 00000100:00100000:1.0:1788625286.800241:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788625286.800610:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875509206216960:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788625286.800655:0:9824:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79eb3 00000100:00080000:1.0:1788625286.800667:0:9824:0:(import.c:65:import_set_state_nolock()) ffff99886c3ad800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788625286.800860:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3634:x1875509206216960:12345-0@lo:39:umount.0 Request processed in 257us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625286.800870:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1788625286.800889:0:9824:0:(genops.c:885:class_export_put()) final put ffff99887b498000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788625286.800926:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b498000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1788625286.800948:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b499800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788625286.800972:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206216960:0@lo:39:umount.0 00000020:00000080:1.0:1788625286.801001:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99886c3ad800 for lustre-MDT0000 00000100:00080000:1.0:1788625286.801449:0:15249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788625286.801456:0:15249:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788625286.801463:0:15249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788625286.802186:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625286.805868:0:15249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a359 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.805888:0:15249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a359 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.805896:0:15249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a359 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.805903:0:15249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a359 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.805938:0:15249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625286.805946:0:15249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a25d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.805953:0:15249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a25d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.805959:0:15249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a25d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.805966:0:15249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a25d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.805984:0:15249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788625286.805991:0:15249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.805997:0:15249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.806002:0:15249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.806008:0:15249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.806020:0:15249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788625286.806025:0:15249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a79e12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79e19 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.806038:0:15249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a79e12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79e19 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.806044:0:15249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a79e12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a79e19 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.806050:0:15249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a79e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a79e19 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625286.806057:0:15249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788625286.806060:0:15249:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788625286.806090:0:15249:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788625286.806094:0:15249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788625286.806098:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625286.806104:0:15249:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788625286.806112:0:15249:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99887ca91000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788625286.806117:0:15249:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99887ca79000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788625286.806122:0:15249:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff998874b3f800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788625286.806127:0:15249:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff998874b57000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1788625286.806135:0:15249:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9987438d3000 44e8506e-584d-40a5-8ecc-bc286c2e90c7 192.168.204.14@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788625286.806140:0:15249:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff998743520000 1338b3dc-3f02-4b26-a9aa-7a14f6033224 192.168.204.14@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:1.0:1788625286.806146:0:15249:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff99885ee54d40) has exports, disconnecting them 00000020:00080000:1.0:1788625286.806151:0:15249:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99887ca91000), last request at 1788625284 00000020:00000080:1.0:1788625286.806158:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a1c3 00000100:00080000:1.0:1788625286.806176:0:15249:0:(import.c:65:import_set_state_nolock()) ffff99887ca96000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788625286.806243:0:15249:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99887ca91000): rc 0 00000020:00000080:1.0:1788625286.806246:0:15249:0:(genops.c:885:class_export_put()) final put ffff99887ca91000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788625286.806255:0:15249:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99887ca79000), last request at 1788625284 00000020:00000080:1.0:1788625286.806258:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a09d 00000100:00080000:1.0:1788625286.806264:0:15249:0:(import.c:65:import_set_state_nolock()) ffff99886c327800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788625286.806273:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca91000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788625286.806311:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887ca96000 for lustre-MDT0000 00000020:00080000:1.0:1788625286.806325:0:15249:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99887ca79000): rc 0 00000020:00000080:1.0:1788625286.806327:0:15249:0:(genops.c:885:class_export_put()) final put ffff99887ca79000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788625286.806334:0:15249:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff998874b3f800), last request at 1788625065 00000020:00000080:1.0:1788625286.806337:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79f9a 00000100:00080000:1.0:1788625286.806341:0:15249:0:(import.c:65:import_set_state_nolock()) ffff998874b3b800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788625286.806350:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca79000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788625286.806374:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99886c327800 for lustre-MDT0000 00000020:00080000:1.0:1788625286.806387:0:15249:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998874b3f800): rc 0 00000020:00000080:1.0:1788625286.806388:0:15249:0:(genops.c:885:class_export_put()) final put ffff998874b3f800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788625286.806395:0:15249:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff998874b57000), last request at 1788625064 00000020:00000080:1.0:1788625286.806399:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79f69 00000100:00080000:1.0:1788625286.806403:0:15249:0:(import.c:65:import_set_state_nolock()) ffff99887b64e800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788625286.806410:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998874b3f800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788625286.806435:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998874b3b800 for lustre-MDT0000 00000001:00000004:1.0:1788625286.806449:0:15249:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:1.0:1788625286.806631:0:15249:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998874b57000): rc 0 00000004:00000080:1.0:1788625286.806637:0:15249:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa6ab07a8bae0 00000100:00080000:1.0:1788625286.806656:0:15249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788625286.806660:0:15249:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1788625286.807044:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788625286.807054:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a359 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807065:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625286.807079:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a359 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807090:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7a359 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625286.807099:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7a359 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625286.807105:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788625286.807108:0:10330:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788625286.807111:0:10330:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1788625286.807164:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a359 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807171:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625286.807201:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a359 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807208:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be8e00/0x2d2e3b3f34a7a352 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a359 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807226:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788625286.807230:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a25d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807235:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625286.807238:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a25d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807244:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7a25d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625286.807257:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7a25d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625286.807263:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788625286.807265:0:10330:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788625286.807267:0:10330:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788625286.807282:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a25d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807297:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625286.807304:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a25d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807311:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b682800/0x2d2e3b3f34a7a256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a25d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807320:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625286.807324:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807330:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840031800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625286.807333:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807339:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7a5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625286.807345:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7a5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625286.807362:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788625286.807364:0:10330:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788625286.807366:0:10330:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788625286.807380:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807385:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625286.807403:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807411:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998840031800/0x2d2e3b3f34a7a5ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a5b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807422:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625286.807426:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a79e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a79e19 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807432:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625286.807435:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a79e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a79e19 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807443:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a79e12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a79e19 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625286.807449:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a79e12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a79e19 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625286.807453:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788625286.807455:0:10330:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788625286.807457:0:10330:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788625286.807476:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a79e12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a79e19 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807482:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625286.807489:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a79e12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a79e19 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807495:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a79e12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a79e19 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.807503:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625286.807505:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625286.807507:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625286.807542:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206217216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625286.807607:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788625286.807657:0:15249:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788625286.807673:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1788625286.807677:0:15249:0:(import.c:65:import_set_state_nolock()) ffff99887b6f1000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788625286.807681:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206217344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625286.807709:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625286.807760:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206217600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625286.807785:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625286.807810:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625286.807816:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206217472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625286.807836:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788625286.807851:0:15249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788625286.807856:0:15249:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000100:00100000:3.0:1788625286.807865:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206217216 00000100:00100000:3.0:1788625286.807872:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206217216 00000004:00080000:1.0:1788625286.807876:0:15249:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788625286.807916:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206217344 00000100:00100000:3.0:1788625286.807919:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206217344 00000100:00100000:3.0:1788625286.807930:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206217600 00000100:00100000:3.0:1788625286.807933:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206217600 00000100:00080000:1.0:1788625286.807935:0:15249:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788625286.807943:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206217472 00000100:00080000:1.0:1788625286.807950:0:15249:0:(import.c:65:import_set_state_nolock()) ffff99887393d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788625286.807954:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206217472 00000100:00080000:1.0:1788625286.807960:0:15249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788625286.807963:0:15249:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1788625286.807974:0:15249:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788625286.807978:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788625286.807986:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+26:3635:x1875509206217216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625286.807998:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625286.808012:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c994200/0x2d2e3b3f34a7a359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a352 expref: 26 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.808025:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1788625286.808041:0:15249:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788625286.808053:0:15249:0:(import.c:65:import_set_state_nolock()) ffff99885ee88000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788625286.808064:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+25:3635:x1875509206217216:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625286.808073:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00080000:1.0:1788625286.808090:0:15249:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff99885ee54d40) has no exports 00000100:00100000:3.0:1788625286.808095:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788625286.808103:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858357480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+24:3635:x1875509206217344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625286.808111:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625286.808121:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c995e00/0x2d2e3b3f34a7a25d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a256 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.808130:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625286.808151:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858357480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+23:3635:x1875509206217344:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625286.808157:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788625286.808169:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788625286.808174:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+22:3638:x1875509206217600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625286.808181:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625286.808189:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882044400/0x2d2e3b3f34a79e19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a79e12 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.808196:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625286.808236:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+21:3638:x1875509206217600:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625286.808242:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788625286.808254:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788625286.808259:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+20:3638:x1875509206217472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625286.808265:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625286.808273:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882045800/0x2d2e3b3f34a7a5b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a5ac expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625286.808283:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625286.808308:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206217600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625286.810694:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6544f02a-cd81-4e03-84c5-408bee21ab7a:3638:1875509206217472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625286.810736:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6544f02a-cd81-4e03-84c5-408bee21ab7a+19:3638:x1875509206217472:12345-0@lo:103:ldlm_bl.0 Request processed in 2384us (2807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625286.810749:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788625286.810811:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206217344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625286.810820:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206217216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625286.810849:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206217728:0@lo:39:umount.0 00000100:00100000:3.0:1788625286.810890:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625286.810925:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206217856:0@lo:9:umount.0 00000100:00100000:3.0:1788625286.810946:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625286.810966:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206217984:0@lo:9:umount.0 00000100:00100000:3.0:1788625286.810987:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625286.811021:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206217856 00000100:00100000:3.0:1788625286.811028:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206217856 00000100:00100000:3.0:1788625286.811079:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206217984 00000100:00100000:1.0:1788625286.811079:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206217728 00000100:00100000:3.0:1788625286.811086:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206217984 00000100:00100000:1.0:1788625286.811087:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206217728 00000100:00100000:3.0:1788625286.811127:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788625286.811130:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788625286.811140:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875509206217728:12345-0@lo:39:umount.0 00000100:00100000:3.0:1788625286.811157:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875509206217856:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788625286.811173:0:6516:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79ff5 00000020:00000080:3.0:1788625286.811177:0:8425:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a145 00000100:00080000:1.0:1788625286.811184:0:6516:0:(import.c:65:import_set_state_nolock()) ffff99887b6f1800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788625286.811186:0:8425:0:(import.c:65:import_set_state_nolock()) ffff998741e0c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788625286.811211:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788625286.811358:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3634:x1875509206217728:12345-0@lo:39:umount.0 Request processed in 218us (467us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788625286.811367:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00010000:00010000:2.0:1788625286.816544:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788625286.816586:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:2.0:1788625286.816776:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625286.817800:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788625286.817822:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875509206217984:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788625286.817854:0:8424:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a28e 00010000:00010000:1.0:1788625286.817896:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788625286.817933:0:8424:0:(import.c:65:import_set_state_nolock()) ffff998743523000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788625286.817986:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:1.0:1788625286.818132:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b6f1000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788625286.818142:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206217728:0@lo:39:umount.0 00000100:00080000:1.0:1788625286.818170:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887393d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788625286.818182:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788625286.818185:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788625286.818187:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206217856:0@lo:9:umount.0 00000100:00100000:2.0:1788625286.818232:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3634:x1875509206217984:12345-0@lo:9:umount.0 Request processed in 419us (7241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625286.818243:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3634:x1875509206217856:12345-0@lo:9:umount.0 Request processed in 7089us (7292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625286.818244:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788625286.818256:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788625286.818279:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99885ee88000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788625286.818290:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788625286.818292:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788625286.818295:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206217984:0@lo:9:umount.0 00000100:00080000:2.0:1788625286.818344:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625286.818349:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788625286.818556:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788625286.819894:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788625286.819908:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1788625286.819914:0:7443:0:(genops.c:885:class_export_put()) final put ffff99887c93d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788625286.819939:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 44e8506e-584d-40a5-8ecc-bc286c2e90c7 00000001:00080000:1.0:1788625286.819946:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1788625286.819949:0:7443:0:(genops.c:885:class_export_put()) final put ffff99874383d800/44e8506e-584d-40a5-8ecc-bc286c2e90c7 00000001:00100000:1.0:1788625286.819954:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000001:00080000:1.0:1788625286.819957:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1788625286.819959:0:7443:0:(genops.c:885:class_export_put()) final put ffff9987427c1800/1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000020:00000080:2.0:1788625286.820136:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887c93d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788625286.820195:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99874383d800/44e8506e-584d-40a5-8ecc-bc286c2e90c7 for lustre-MDT0001 00000020:00000080:2.0:1788625286.820221:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9987427c1800/1338b3dc-3f02-4b26-a9aa-7a14f6033224 for lustre-MDT0001 00000020:00000080:2.0:1788625286.820250:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887b6f1800 for lustre-MDT0001 00000020:00000080:2.0:1788625286.820255:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99874383c800 for lustre-MDT0001 00000020:00000080:2.0:1788625286.820259:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887b611000 for lustre-MDT0001 00000001:00100000:2.0:1788625286.822990:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788625286.822999:0:8419:0:(genops.c:885:class_export_put()) final put ffff998741e0f000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788625286.823026:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000020:00000080:2.0:1788625286.823029:0:8419:0:(genops.c:885:class_export_put()) final put ffff998743af7800/1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000020:00000080:1.0:1788625286.823118:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998741e0f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788625286.823172:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998743af7800/1338b3dc-3f02-4b26-a9aa-7a14f6033224 for lustre-OST0000 00000020:00000080:1.0:1788625286.823195:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998741e0c000 for lustre-OST0000 00000020:00000080:1.0:1788625286.823204:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998743af0800 for lustre-OST0000 00000001:00100000:1.0:1788625286.824039:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788625286.824044:0:6490:0:(genops.c:885:class_export_put()) final put ffff998874b57000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788625286.824069:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 44e8506e-584d-40a5-8ecc-bc286c2e90c7 00000001:00080000:1.0:1788625286.824076:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788625286.824079:0:6490:0:(genops.c:885:class_export_put()) final put ffff9987438d3000/44e8506e-584d-40a5-8ecc-bc286c2e90c7 00000001:00100000:1.0:1788625286.824084:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000001:00080000:1.0:1788625286.824106:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1788625286.824113:0:6490:0:(genops.c:885:class_export_put()) final put ffff998743520000/1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000020:00000080:2.0:1788625286.824224:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff998874b57000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788625286.824261:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9987438d3000/44e8506e-584d-40a5-8ecc-bc286c2e90c7 for lustre-MDT0000 00000020:00000080:2.0:1788625286.824280:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff998743520000/1338b3dc-3f02-4b26-a9aa-7a14f6033224 for lustre-MDT0000 00000020:00000080:2.0:1788625286.824312:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887b64e800 for lustre-MDT0000 00000020:00000080:2.0:1788625286.824316:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9987438d2800 for lustre-MDT0000 00000020:00000080:2.0:1788625286.824327:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998743521800 for lustre-MDT0000 00000001:00100000:2.0:1788625286.824551:0:9503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788625286.824556:0:9503:0:(genops.c:885:class_export_put()) final put ffff998743527800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788625286.824571:0:9503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000020:00000080:2.0:1788625286.824574:0:9503:0:(genops.c:885:class_export_put()) final put ffff998744148000/1338b3dc-3f02-4b26-a9aa-7a14f6033224 00000020:00000080:1.0:1788625286.824701:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff998743527800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788625286.824737:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff998744148000/1338b3dc-3f02-4b26-a9aa-7a14f6033224 for lustre-OST0001 00000020:00000080:1.0:1788625286.824758:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998743523000 for lustre-OST0001 00000020:00000080:1.0:1788625286.824761:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998744149800 for lustre-OST0001 00000020:00080000:3.0:1788625286.829176:0:15249:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff99885ee54d40) has no exports 00000020:00000080:3.0:1788625286.892185:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79e6d 00000020:00000080:3.0:1788625286.892204:0:15249:0:(genops.c:885:class_export_put()) final put ffff99887b49c000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788625286.892237:0:15249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788625286.892360:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625286.892372:0:15249:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788625286.892377:0:15249:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff99887b48cd40) has no exports 00000020:00000080:0.0:1788625286.892637:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b49c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788625286.892901:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79e66 00000020:00000080:2.0:1788625286.892907:0:15249:0:(genops.c:885:class_export_put()) final put ffff99887b47f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788625286.892962:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625286.892970:0:15249:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788625286.892973:0:15249:0:(genops.c:885:class_export_put()) final put ffff99887b47f000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788625286.892975:0:15249:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b47f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788625286.892984:0:15249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788625286.893143:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b47f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788625286.893196:0:15249:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9987434c2ea0 - data ffff99874203b6c0/ffff998742edbc00 00000020:01000000:2.0:1788625286.893335:0:15249:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99887b552420 - data ffff998867973870/ffff99887b57f800 00000001:00000004:2.0:1788625286.911866:0:15249:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1788625286.958423:0:15249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788625286.958432:0:15249:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788625286.958448:0:15249:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff998743b30700 x1875509206217728/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788625296 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625286.958473:0:15249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788625286.960027:0:15249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788625286.960036:0:15249:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1788625286.960058:0:15249:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788625286.960060:0:15249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788625286.960458:0:8864:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788625286.960463:0:8864:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788625286.960473:0:8864:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788625286.961247:0:15249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788625286.961253:0:15249:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1788625286.961327:0:15249:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788625286.961331:0:15249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788625286.961598:0:10008:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788625286.961601:0:10008:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788625286.961610:0:10008:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788625286.962994:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79e35 00000020:00000080:2.0:1788625286.963005:0:15249:0:(genops.c:885:class_export_put()) final put ffff9988449cb000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788625286.965187:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79e4a 00000020:00000080:2.0:1788625286.965205:0:15249:0:(genops.c:885:class_export_put()) final put ffff9988449cd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788625286.965281:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9988449cb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788625286.965395:0:15249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788625286.965402:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625286.965410:0:15249:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788625286.965414:0:15249:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff99885ee53380) has no exports 00000004:01000000:2.0:1788625286.965671:0:15249:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788625286.965682:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a280 00000020:00000080:2.0:1788625286.965687:0:15249:0:(genops.c:885:class_export_put()) final put ffff99885ee8e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788625286.965736:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9988449cd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788625286.965799:0:15249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788625286.965803:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625286.965813:0:15249:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788625286.965816:0:15249:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff99887cb199c0) has no exports 00000020:00000080:2.0:1788625286.965823:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a279 00000020:00000080:2.0:1788625286.965827:0:15249:0:(genops.c:885:class_export_put()) final put ffff99885ee8f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788625286.965900:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99885ee8e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1788625286.966319:0:15249:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788625286.966324:0:15249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788625286.966328:0:15249:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1788625286.966333:0:15249:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788625286.966335:0:15249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788625286.966423:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99885ee8f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788625286.966508:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625286.966555:0:15249:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788625286.966562:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a13e 00000020:00000080:2.0:1788625286.966568:0:15249:0:(genops.c:885:class_export_put()) final put ffff99887b6f0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788625286.966661:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99885ee88000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788625286.966673:0:37:0:(genops.c:885:class_export_put()) final put ffff99885ee8b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788625286.966675:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99885ee8b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788625286.966716:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788625286.966984:0:15249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788625286.967022:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b6f0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788625286.967036:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625286.967043:0:15249:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788625286.967047:0:15249:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff99887b4899c0) has no exports 00000020:00000080:1.0:1788625286.967054:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a137 00000020:00000080:1.0:1788625286.967058:0:15249:0:(genops.c:885:class_export_put()) final put ffff99887393b000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788625286.967451:0:15249:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788625286.967455:0:15249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788625286.967460:0:15249:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1788625286.967465:0:15249:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788625286.967467:0:15249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788625286.967491:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887393b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788625286.967651:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788625286.967660:0:15249:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788625286.967672:0:15249:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788625286.967678:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79fee 00000020:00000080:1.0:1788625286.967683:0:15249:0:(genops.c:885:class_export_put()) final put ffff99887c938800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788625286.967738:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887393d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788625286.967745:0:37:0:(genops.c:885:class_export_put()) final put ffff99887b6f2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788625286.967760:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b6f2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788625286.967765:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788625286.967937:0:15249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788625286.967941:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625286.967946:0:15249:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788625286.967949:0:15249:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff99887394b380) has no exports 00000020:00000080:1.0:1788625286.967954:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79fe7 00000020:00000080:1.0:1788625286.967958:0:15249:0:(genops.c:885:class_export_put()) final put ffff99887b6f4800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788625286.967974:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887c938800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788625286.968424:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b6f4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788625286.969577:0:15249:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788625286.969584:0:15249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788625286.969588:0:15249:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788625286.969605:0:15249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788625286.969658:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625286.969669:0:15249:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788625286.969692:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625286.969695:0:15249:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788625286.969700:0:15249:0:(genops.c:885:class_export_put()) final put ffff9988449cc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788625286.969704:0:15249:0:(genops.c:844:class_export_destroy()) destroying export ffff9988449cc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788625286.969723:0:15249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788625286.969891:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79e51 00000020:00000080:0.0:1788625286.969898:0:15249:0:(genops.c:885:class_export_put()) final put ffff9988449c9800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788625286.969903:0:15249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788625286.969907:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625286.969911:0:15249:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788625286.969914:0:15249:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9988449d4d40) has no exports 00000020:00000080:0.0:1788625286.969931:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625286.969934:0:15249:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788625286.969938:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79e58 00000020:00000080:0.0:1788625286.969942:0:15249:0:(genops.c:885:class_export_put()) final put ffff9988449ca800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788625286.969951:0:15249:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998852348000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788625286.969954:0:15249:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998852348000 3 00000020:01000004:0.0:1788625286.969958:0:15249:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff998852348000 from lustre-MDT0000 00000020:00000080:0.0:1788625286.969976:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625286.969980:0:15249:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788625286.969983:0:15249:0:(genops.c:885:class_export_put()) final put ffff9988449cf800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788625286.969985:0:15249:0:(genops.c:844:class_export_destroy()) destroying export ffff9988449cf800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788625286.969992:0:15249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788625286.970021:0:15249:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788625286.970025:0:15249:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788625286.970027:0:15249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788625286.970030:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625286.970033:0:15249:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788625286.970039:0:15249:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff99885e64b000 6544f02a-cd81-4e03-84c5-408bee21ab7a 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788625286.970050:0:15249:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff99885ee50000) has exports, disconnecting them 00000020:00080000:0.0:1788625286.970054:0:15249:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99885e64b000), last request at 1788625043 00000020:00000080:0.0:1788625286.970069:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79df6 00000020:00010000:0.0:1788625286.970072:0:15249:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99885e64b000: total 2 00000100:00080000:0.0:1788625286.970076:0:15249:0:(import.c:65:import_set_state_nolock()) ffff998866c7f000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788625286.970086:0:15249:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99885e64b000): rc 0 00000020:00080000:0.0:1788625286.970090:0:15249:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff99885ee50000) has no exports 00000020:00010000:2.0:1788625286.970166:0:6499:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99885e64b000: total 2 00010000:00010000:2.0:1788625286.970203:0:6499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99885e64b000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788625286.970233:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac6600/0x2d2e3b3f34a7a2f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a2f0 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.970249:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be9000/0x2d2e3b3f34a7a305 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a2fe expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.970260:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c995800/0x2d2e3b3f34a7a217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a210 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.970273:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887cac6c00/0x2d2e3b3f34a7a367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a360 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.970285:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c995400/0x2d2e3b3f34a7a321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a31a expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.970295:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be8000/0x2d2e3b3f34a7a313 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a30c expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.970309:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998840031200/0x2d2e3b3f34a7a589 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a582 expref: 8 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.970319:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887c994a00/0x2d2e3b3f34a7a32f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a328 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.970329:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be9a00/0x2d2e3b3f34a7a33d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a336 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.970352:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882044c00/0x2d2e3b3f34a79ef2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a79eeb expref: 5 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.970365:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7a5a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a59e expref: 4 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.970375:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882044600/0x2d2e3b3f34a79f00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a79ef9 expref: 3 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.970387:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998840030a00/0x2d2e3b3f34a7a597 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7a590 expref: 2 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625286.970397:0:6499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99885e64b000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788625286.970412:0:6499:0:(genops.c:885:class_export_put()) final put ffff99885e64b000/6544f02a-cd81-4e03-84c5-408bee21ab7a 00010000:00010000:2.0:1788625286.970417:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625286.970419:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625286.970422:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788625286.970430:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887b6f1000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788625286.970436:0:37:0:(genops.c:885:class_export_put()) final put ffff998874b38000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788625286.970439:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998874b38000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788625286.970443:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788625286.970477:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9988449c9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788625286.970481:0:37:0:(genops.c:885:class_export_put()) final put ffff9988449ce000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788625286.970483:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9988449ce000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788625286.970486:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788625286.970510:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9988449ca800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788625286.970573:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99885e64b000/6544f02a-cd81-4e03-84c5-408bee21ab7a for MGS 00000020:00000080:2.0:1788625286.970726:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998866c7f000 for MGS 00000100:00100000:2.0:1788625286.971599:0:6503:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99887807a400:6503] 0 exiting: rc = 1 00000100:00100000:2.0:1788625286.971935:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9988780ce400:6505] 1 exiting: rc = 0 00000100:00100000:0.0:1788625286.972127:0:6506:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9988780cfa00:6506] 2 exiting: rc = 0 00000100:00100000:2.0:1788625286.972261:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972270:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972275:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972282:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972288:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972294:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972300:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972307:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972312:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972318:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972324:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972329:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972334:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972343:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972352:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972359:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972594:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972607:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972890:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972904:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972910:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972916:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972922:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972928:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972933:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972939:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972945:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972951:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972957:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972967:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972976:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972982:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.972988:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973012:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973018:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973024:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973366:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973376:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973382:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973659:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973669:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973674:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973679:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973685:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973690:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973695:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973701:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973716:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973723:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973727:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973733:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973738:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973744:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973749:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973754:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973759:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973765:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973835:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973844:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973850:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973856:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973861:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973867:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625286.973872:0:15249:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788625286.975501:0:15249:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998741e791e0 - data ffff998848f09798/ffff9987426e0800 00000020:01000000:2.0:1788625286.975912:0:15249:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998843520a20 - data ffff9988603f6798/ffff99885e6a7000 00000020:00000080:2.0:1788625286.976433:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79dda 00000020:00000080:2.0:1788625286.976459:0:15249:0:(genops.c:885:class_export_put()) final put ffff998851ec0800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788625286.976539:0:15249:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998852348000 from MGS, refs=2 00000020:01000004:2.0:1788625286.976543:0:15249:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998852348000 2 00000020:01000004:2.0:1788625286.976546:0:15249:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff998852348000 from MGS 00000020:00000080:2.0:1788625286.976573:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625286.976597:0:15249:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788625286.976600:0:15249:0:(genops.c:885:class_export_put()) final put ffff998845d82000/MGS 00000020:00000080:2.0:1788625286.976841:0:15249:0:(genops.c:844:class_export_destroy()) destroying export ffff998845d82000/MGS for MGS 00000020:01000000:2.0:1788625286.976850:0:15249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788625286.976981:0:15249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788625286.976986:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625286.976992:0:15249:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788625286.976999:0:15249:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99887b49d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788625286.977005:0:15249:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff99885ecdb380) has exports, disconnecting them 00000020:00080000:2.0:1788625286.977019:0:15249:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99887b49d000), last request at 1788625044 00000020:00000080:2.0:1788625286.977025:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79ea5 00000020:00080000:2.0:1788625286.977038:0:15249:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99887b49d000): rc 0 00000020:00000080:2.0:1788625286.977042:0:15249:0:(genops.c:885:class_export_put()) final put ffff99887b49d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788625286.977145:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998851ec0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788625286.978189:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b49d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788625286.983653:0:15249:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788625286.983665:0:15249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788625286.983670:0:15249:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788625286.983681:0:15249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788625286.983719:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887b499800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788625286.983946:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625286.983955:0:15249:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788625286.983961:0:15249:0:(genops.c:885:class_export_put()) final put ffff99887b49a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788625286.983965:0:15249:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b49a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788625286.983977:0:15249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788625286.984066:0:15249:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998852348000 1 00000020:00000080:0.0:1788625286.984073:0:15249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79dcc 00000020:00000080:0.0:1788625286.984080:0:15249:0:(genops.c:885:class_export_put()) final put ffff998845d87000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788625286.984088:0:15249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788625286.984096:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998845d87000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788625286.984108:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625286.984113:0:15249:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788625286.984117:0:15249:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff99885e6299c0) has no exports 00000020:00000080:0.0:1788625287.056738:0:15249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625287.056764:0:15249:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788625287.056772:0:15249:0:(genops.c:885:class_export_put()) final put ffff99885234d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788625287.056777:0:15249:0:(genops.c:844:class_export_destroy()) destroying export ffff99885234d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788625287.056788:0:15249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788625287.057042:0:15249:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff998852348800 00000020:02000400:0.0:1788625287.057111:0:15249:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788625287.244598:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625288.268087:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625289.293078:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625289.483823:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625289.483846:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206218112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625289.483916:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625289.484054:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206218112 00000100:00100000:0.0:1788625289.484063:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206218112 00000100:00100000:0.0:1788625289.484129:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788625289.484138:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206218112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625289.484176:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788625289.484221:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206218112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625289.484228:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1788625289.484383:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625289.484419:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206218112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625290.000282:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206218240:0@lo:400:kworker.0 00000400:00000100:3.0:1788625290.000341:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875509206218240 offset 0 length 224: 4 00000100:00100000:0.0:1788625290.000481:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206218624:0@lo:400:kworker.0 00000100:00100000:0.0:1788625290.000538:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625290.000581:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206218624 00000100:00100000:0.0:1788625290.000588:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206218624 00000100:00100000:0.0:1788625290.000627:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788625290.000635:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1875509206218624:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788625290.000643:0:6513:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788625290.000692:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1875509206218624:12345-0@lo:400:kworker.0 Request processed in 56us (152us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788625290.000699:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:0.0:1788625290.000740:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788625290.000747:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9988749d4800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788625290.000751:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788625290.003943:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206218368:0@lo:400:kworker.0 00000100:00100000:3.0:1788625290.004018:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625290.004054:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625290.004062:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206218496:0@lo:400:kworker.0 00000100:00100000:3.0:1788625290.004864:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625290.004909:0:14517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206218368 00000100:00100000:3.0:1788625290.004917:0:14517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206218368 00000100:00100000:3.0:1788625290.004963:0:14517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788625290.004971:0:14517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1875509206218368:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788625290.004980:0:14517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788625290.005021:0:14517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1875509206218368:12345-0@lo:400:kworker.0 Request processed in 48us (1002us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788625290.005028:0:14517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788625290.005058:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206218496 00000100:00100000:3.0:1788625290.005061:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206218496 00000100:00100000:3.0:1788625290.005851:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788625290.005858:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1875509206218496:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788625290.005864:0:6512:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788625290.005907:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1875509206218496:12345-0@lo:400:kworker.0 Request processed in 48us (1044us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788625290.005912:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:3.0:1788625290.005969:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788625290.005974:0:3637:0:(import.c:65:import_set_state_nolock()) ffff99887c875800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788625290.005978:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788625290.005984:0:3637:0:(import.c:65:import_set_state_nolock()) ffff99887c875800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625290.005988:0:3637:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 186 00000100:00080000:3.0:1788625290.005994:0:3637:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99887c875800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625290.006027:0:3637:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874483b100 x1875509206218752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625290.006055:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206218496:0@lo:400:kworker.0 00000100:00080000:3.0:1788625290.006070:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1788625290.006269:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625290.006282:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206219008:0@lo:400:kworker.0 00000100:00100000:1.0:1788625290.006326:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625290.006358:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206219008 00000100:00100000:1.0:1788625290.006363:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206219008 00000100:00100000:1.0:1788625290.006399:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788625290.006405:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206219008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625290.006446:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206219008:12345-0@lo:400:kworker.0 Request processed in 42us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625290.006453:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788625290.006479:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206219008:0@lo:400:kworker.0 00000100:00100000:1.0:1788625290.006508:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206219136:0@lo:400:kworker.0 00000100:00100000:1.0:1788625290.006547:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625290.006574:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206219136 00000100:00100000:1.0:1788625290.006578:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206219136 00000100:00100000:1.0:1788625290.006607:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788625290.006612:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1875509206219136:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788625290.006616:0:9824:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788625290.006643:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1875509206219136:12345-0@lo:400:kworker.0 Request processed in 30us (96us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788625290.006660:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1788625290.006680:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788625290.006684:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99887cb8f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788625290.006688:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788625290.006691:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99887cb8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625290.006694:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 223 00000100:00080000:1.0:1788625290.006698:0:3638:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99887cb8f800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625290.006718:0:3638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874407a300 x1875509206219264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788625290.006730:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206219136:0@lo:400:kworker.0 00000100:00080000:3.0:1788625290.010237:0:3637:0:(import.c:65:import_set_state_nolock()) ffff99887393c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788625290.010251:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788625290.010258:0:3637:0:(import.c:65:import_set_state_nolock()) ffff99887393c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625290.010264:0:3637:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 186 00000100:00080000:3.0:1788625290.010275:0:3637:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99887393c800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625290.010322:0:3637:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9987442d7b80 x1875509206219648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625290.010350:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206218368:0@lo:400:kworker.0 00000100:00100000:3.0:1788625290.010399:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875509206218752:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788625290.010467:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625290.010506:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206219264:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788625290.010543:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625290.010560:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206219648:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788625290.010582:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625290.010623:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206219648 00000100:00100000:3.0:1788625290.010630:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206219648 00000100:00100000:3.0:1788625290.010674:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788625290.010681:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875509206219648:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788625290.010700:0:6517:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788625290.010817:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875509206219648:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 134us (233us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788625290.010824:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:3.0:1788625290.010859:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887393c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625290.010863:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625290.010866:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206219648:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788625290.010885:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206218752 00000100:00100000:3.0:1788625290.010889:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206218752 00000100:00100000:3.0:1788625290.010906:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206219264 00000100:00100000:3.0:1788625290.010908:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206219264 00000100:00100000:3.0:1788625290.010923:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788625290.010928:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875509206218752:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788625290.010945:0:6512:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788625290.010976:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875509206218752:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 47us (509us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788625290.010983:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788625290.010994:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788625290.010997:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875509206219264:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1788625290.011006:0:6512:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788625290.011029:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875509206219264:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 30us (486us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788625290.011035:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1788625290.011058:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887c875800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625290.011062:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625290.011065:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875509206218752:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1788625290.011072:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887cb8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625290.011075:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625290.011078:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206219264:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788625290.011115:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206218880:0@lo:400:kworker.0 00000100:00100000:3.0:1788625290.011143:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625290.011166:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206219520:0@lo:400:kworker.0 00000100:00100000:3.0:1788625290.011188:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625290.011207:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625290.011214:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206219392:0@lo:400:kworker.0 00000100:00100000:3.0:1788625290.011232:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625290.011267:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206219520 00000100:00100000:3.0:1788625290.011271:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206219520 00000100:00100000:3.0:1788625290.011313:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788625290.011321:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206219520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625290.011361:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206219520:12345-0@lo:400:kworker.0 Request processed in 42us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625290.011366:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788625290.011382:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206218880 00000100:00100000:3.0:1788625290.011385:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206218880 00000100:00100000:3.0:1788625290.011404:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206219392 00000100:00100000:3.0:1788625290.011407:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206219392 00000100:00100000:3.0:1788625290.011421:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788625290.011426:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206218880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625290.011455:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206218880:12345-0@lo:400:kworker.0 Request processed in 29us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625290.011462:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788625290.011473:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788625290.011479:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206219392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625290.011505:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206219392:12345-0@lo:400:kworker.0 Request processed in 27us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625290.011512:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00080000:3.0:1788625290.011546:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625290.011550:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788625290.011571:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff998744079f80 x1875509206219392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625290.011583:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206219392:0@lo:400:kworker.0 00010000:00080000:3.0:1788625290.011592:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9988449aed80 x1875509206218880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625290.011606:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206218880:0@lo:400:kworker.0 00000100:00100000:3.0:1788625290.011618:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206219520:0@lo:400:kworker.0 00000100:00080000:0.0:1788625290.023219:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9988749d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625290.023234:0:3635:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 204 00000100:00080000:0.0:1788625290.023245:0:3635:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9988749d4800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625290.023335:0:3635:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874482aa00 x1875509206219776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625290.023366:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206218624:0@lo:400:kworker.0 00000100:00100000:2.0:1788625290.023643:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206219776:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788625290.023721:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625290.028918:0:9824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206219776 00000100:00100000:0.0:1788625290.028936:0:9824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206219776 00000100:00100000:0.0:1788625290.028984:0:9824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788625290.028992:0:9824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1875509206219776:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788625290.029015:0:9824:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788625290.030405:0:9824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1875509206219776:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 1408us (6678us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788625290.030416:0:9824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1788625290.030471:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9988749d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625290.030476:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788625290.030480:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206219776:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1788625290.316055:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625290.508185:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206219904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625290.508258:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625290.508313:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206219904 00000100:00100000:2.0:1788625290.508323:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206219904 00000100:00100000:2.0:1788625290.508389:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788625290.508402:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206219904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625290.508443:0:10091:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788625290.508506:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206219904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625290.508513:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788625290.508566:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206219904:0@lo:13:osp-pre-1-1.0 00000020:01000004:2.0:1788625290.817421:0:15449:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788625290.843614:0:15449:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788625290.843722:0:15449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a32f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.843738:0:15449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a32f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.843746:0:15449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a32f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.843753:0:15449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a32f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.843765:0:15449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788625290.843770:0:15449:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788625290.843794:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788625290.843798:0:15449:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788625290.843803:0:15449:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788625290.843809:0:15449:0:(import.c:65:import_set_state_nolock()) ffff99887c875800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788625290.843814:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788625290.843816:0:15449:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788625290.843819:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788625290.844322:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625290.844331:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a32f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625290.844339:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625290.844342:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a32f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625290.844351:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7a32f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625290.844358:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7a32f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625290.844364:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788625290.844366:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788625290.844369:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788625290.844404:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a32f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625290.844411:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625290.844442:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a32f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625290.844450:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b683e00/0x2d2e3b3f34a7a328 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a32f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625290.844468:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625290.844470:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625290.844471:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625290.844479:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625290.844495:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206220032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625290.844575:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625290.844642:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206220032 00000100:00100000:2.0:1788625290.844649:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206220032 00000100:00100000:2.0:1788625290.844685:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788625290.844692:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872679450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3637:x1875509206220032:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788625290.844698:0:6497:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788625290 with bad export cookie 3255604723287825910 00010000:00010000:3.0:1788625290.846665:0:15449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a33d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.846683:0:15449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a33d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.846691:0:15449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a33d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.846697:0:15449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a33d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.846724:0:15449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625290.846731:0:15449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a217 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.846738:0:15449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a217 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.846744:0:15449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a217 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.846751:0:15449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a217 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.846764:0:15449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788625290.846782:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625290.846788:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a33d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.846795:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8a00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625290.846811:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a33d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.846819:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7a33d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625290.846826:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7a33d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625290.846833:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788625290.846835:0:10330:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1788625290.846861:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a33d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.846868:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625290.846888:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a33d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.846896:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be8a00/0x2d2e3b3f34a7a336 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a33d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.846914:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625290.846917:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a217 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.846923:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887c995200 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625290.846925:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a217 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.846932:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7a217 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625290.847196:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625290.847514:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206220160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625290.847592:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625290.847666:0:9513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206220160 00000100:00100000:0.0:1788625290.847672:0:9513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206220160 00000100:00100000:0.0:1788625290.847708:0:9513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788625290.847715:0:9513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3635:x1875509206220160:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788625290.847730:0:9513:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788625290 with bad export cookie 3255604723287825910 00000100:00100000:0.0:1788625290.847775:0:9513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3635:x1875509206220160:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (182us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788625290.847783:0:9513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788625290.847822:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788625290.847827:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9988582ef800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788625290.847831:0:3635:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.114@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 10000000:00010000:3.0:1788625290.847906:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7a217 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625290.847912:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788625290.847914:0:10330:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788625290.847917:0:10330:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:2.0:1788625290.859784:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872679450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3637:x1875509206220032:12345-0@lo:103:ldlm_bl.0 Request processed in 15084us (15202us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788625290.859800:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788625290.859892:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788625290.879054:0:3635:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.114@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788625290.879060:0:3635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788625290.879070:0:3635:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff998744832680 x1875509206218240/t0(0) o400->MGC192.168.204.114@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788625305 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625290.879085:0:3635:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99874427c380 x1875509206220032/t0(0) o103->MGC192.168.204.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788625306 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625290.879095:0:3635:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9987442d5f80 x1875509206220160/t0(0) o103->MGC192.168.204.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788625306 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788625290.879217:0:3635:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788625290.879221:0:3635:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788625290.879222:0:3635:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788625290.879273:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9988582ef800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625290.879280:0:3635:0:(import.c:545:import_select_connection()) MGC192.168.204.114@tcp: connect to NID 0@lo last attempt 164 00000100:00080000:0.0:1788625290.879289:0:3635:0:(import.c:665:import_select_connection()) MGC192.168.204.114@tcp: import ffff9988582ef800 using connection 192.168.204.114@tcp/0@lo 00000100:00080000:2.0:1788625290.879336:0:3637:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9988582ef800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:3.0:1788625290.879756:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:3636:1875509206218240:0@lo:400:kworker.0 00010000:00010000:0.0:1788625290.879782:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a217 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625290.879792:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788625290.879797:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6544f02a-cd81-4e03-84c5-408bee21ab7a:3637:1875509206220032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625290.879817:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6544f02a-cd81-4e03-84c5-408bee21ab7a:0:1875509206220288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625290.879817:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a217 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625290.879825:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887c995200/0x2d2e3b3f34a7a210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7a217 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625290.879861:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625290.879864:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625290.879866:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625290.879880:0:15449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a5a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625290.879890:0:15449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a5a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625290.879898:0:15449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a5a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625290.879905:0:15449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a5a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625290.879930:0:15449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625290.879938:0:15449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840030800/0x2d2e3b3f34a79ef9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a79f00 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625290.879945:0:15449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840030800/0x2d2e3b3f34a79ef9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a79f00 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625290.879951:0:15449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840030800/0x2d2e3b3f34a79ef9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a79f00 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625290.879956:0:15449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998840030800/0x2d2e3b3f34a79ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a79f00 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625290.880144:0:15449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788625290.880156:0:15449:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1788625290.880159:0:15449:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788625290.880192:0:15449:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788625290.880195:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788625290.880200:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625290.880205:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788625290.880210:0:15449:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff99887ca93000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788625290.880216:0:15449:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff99887b614000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788625290.880221:0:15449:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff99885ecd8000) has exports, disconnecting them 00010000:00010000:3.0:1788625290.880227:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625290.880233:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a5a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.880240:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840030e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625290.880244:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a5a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.880252:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7a5a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625290.880259:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7a5a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625290.880265:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788625290.880268:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788625290.880270:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788625290.880283:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9988582ef800 00000020:00080000:0.0:1788625290.880287:0:15449:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99887ca93000), last request at 1788625290 00010000:00010000:3.0:1788625290.880292:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7a5a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788625290.880295:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a1d8 00010000:00010000:3.0:1788625290.880299:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998840030e00/0x2d2e3b3f34a7a59e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7a5a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788625290.880308:0:15449:0:(import.c:65:import_set_state_nolock()) ffff998741e08000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788625290.880309:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625290.880312:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998840030800/0x2d2e3b3f34a79ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a79f00 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.880317:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840030800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625290.880320:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998840030800/0x2d2e3b3f34a79ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a79f00 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625290.880327:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998840030800/0x2d2e3b3f34a79ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a79f00 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625290.880333:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998840030800/0x2d2e3b3f34a79ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a79f00 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625290.880338:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788625290.880340:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788625290.880341:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788625290.880346:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9988582ef800 00010000:00010000:3.0:1788625290.880349:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998840030800/0x2d2e3b3f34a79ef9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a79f00 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788625290.880352:0:15449:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99887ca93000): rc 0 00010000:00010000:3.0:1788625290.880355:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998840030800/0x2d2e3b3f34a79ef9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a79f00 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788625290.880355:0:15449:0:(genops.c:885:class_export_put()) final put ffff99887ca93000/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:3.0:1788625290.880365:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788625290.880365:0:15449:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99887b614000), last request at 1788625290 00000020:00000080:0.0:1788625290.880368:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a0b2 00010000:00010000:3.0:1788625290.880371:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625290.880373:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788625290.880384:0:15449:0:(import.c:65:import_set_state_nolock()) ffff99887b613800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788625290.880400:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca93000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00010000:00010000:2.0:1788625290.880403:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625290.880427:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788625290.880449:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998741e08000 for lustre-MDT0001 00000020:00080000:0.0:1788625290.880461:0:15449:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99887b614000): rc 0 00000020:00000080:0.0:1788625290.880463:0:15449:0:(genops.c:885:class_export_put()) final put ffff99887b614000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:1.0:1788625290.880471:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:0.0:1788625290.880481:0:15449:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa6ab017b3ae0 00000100:00080000:0.0:1788625290.880499:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788625290.880502:0:15449:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:1.0:1788625290.880503:0:3635:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998744079c00 x1875509206220416/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1788625290.880553:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b614000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788625290.880585:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887b613800 for lustre-MDT0001 00000100:00100000:2.0:1788625290.881083:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6544f02a-cd81-4e03-84c5-408bee21ab7a:3634:1875509206220416:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1788625290.881129:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875509206220416 offset 0 length 520: 4 00000100:00100000:1.0:1788625290.881214:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6544f02a-cd81-4e03-84c5-408bee21ab7a:3635:1875509206220160:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788625290.881277:0:15449:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788625290.881282:0:15449:0:(import.c:65:import_set_state_nolock()) ffff99887393c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788625290.882164:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788625290.882169:0:15449:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1788625290.882236:0:15449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788625290.882292:0:15449:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788625290.882312:0:15449:0:(import.c:65:import_set_state_nolock()) ffff9987424e0800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788625290.882332:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788625290.882334:0:15449:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1788625290.882348:0:15449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788625290.882420:0:15449:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788625290.882430:0:15449:0:(import.c:65:import_set_state_nolock()) ffff99887cb8a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788625290.882456:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff99885ecd8000) has no exports 00000100:00100000:2.0:1788625290.882616:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206220544:0@lo:9:umount.0 00000100:00100000:2.0:1788625290.882683:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625290.882754:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206220672:0@lo:9:umount.0 00000100:00100000:2.0:1788625290.882779:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625290.883270:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206220544 00000100:00100000:0.0:1788625290.883279:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206220544 00000100:00100000:0.0:1788625290.883329:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206220672 00000100:00100000:0.0:1788625290.883332:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206220672 00000100:00100000:0.0:1788625290.883364:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788625290.883382:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875509206220544:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788625290.883408:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a106 00000100:00080000:0.0:1788625290.883416:0:8423:0:(import.c:65:import_set_state_nolock()) ffff998741e08800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788625290.883453:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788625290.883640:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3634:x1875509206220544:12345-0@lo:9:umount.0 Request processed in 256us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625290.883648:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788625290.883665:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788625290.883671:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875509206220672:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788625290.883683:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a241 00000100:00080000:0.0:1788625290.883688:0:8423:0:(import.c:65:import_set_state_nolock()) ffff99885ee89800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788625290.883891:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9987424e0800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788625290.883910:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788625290.883912:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788625290.883916:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206220544:0@lo:9:umount.0 00010000:00010000:2.0:1788625290.884035:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788625290.884220:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:3.0:1788625290.884347:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625290.884384:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3634:x1875509206220672:12345-0@lo:9:umount.0 Request processed in 712us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625290.884403:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788625290.890865:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887cb8a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788625290.890896:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788625290.890899:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788625290.890905:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206220672:0@lo:9:umount.0 00000020:00080000:1.0:1788625290.900913:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff99885ecd8000) has no exports 00000020:01000000:0.0:1788625290.965025:0:15449:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998850b2dcc0 - data ffff998867ad4288/ffff9987427b6400 00000020:01000000:0.0:1788625290.965222:0:15449:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99887ca5ab40 - data ffff99886038d360/ffff99887ca6ec00 00000001:00000004:2.0:1788625290.986660:0:15449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788625291.047148:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788625291.047158:0:15449:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788625291.047167:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788625291.051684:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788625291.051692:0:15449:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788625291.051712:0:15449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788625291.051715:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788625291.052297:0:8858:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788625291.052302:0:8858:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788625291.052323:0:8858:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788625291.055034:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788625291.055042:0:15449:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788625291.055898:0:15449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788625291.055903:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788625291.064980:0:10003:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788625291.064990:0:10003:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788625291.065009:0:10003:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788625291.067927:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79f1c 00000020:00000080:2.0:1788625291.067940:0:15449:0:(genops.c:885:class_export_put()) final put ffff99887393f800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788625291.068057:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887393f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788625291.071332:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79f31 00000020:00000080:2.0:1788625291.071345:0:15449:0:(genops.c:885:class_export_put()) final put ffff99886c3ab800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788625291.071353:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788625291.071358:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625291.071364:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788625291.071368:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff99885ecdcd40) has no exports 00000020:00000080:0.0:1788625291.071796:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99886c3ab800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:2.0:1788625291.072177:0:15449:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788625291.072186:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a23a 00000020:00000080:2.0:1788625291.072200:0:15449:0:(genops.c:885:class_export_put()) final put ffff99887cb8d800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788625291.072206:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788625291.072209:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625291.072217:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788625291.072220:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9988449d3380) has no exports 00000020:00000080:2.0:1788625291.072225:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a233 00000020:00000080:2.0:1788625291.072229:0:15449:0:(genops.c:885:class_export_put()) final put ffff99887ca93800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788625291.074829:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887cb8d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788625291.074847:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca93800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788625291.075931:0:15449:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788625291.075937:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788625291.075942:0:15449:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1788625291.075948:0:15449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788625291.075951:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788625291.076003:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625291.076017:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788625291.076026:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a0f8 00000020:00000080:2.0:1788625291.076039:0:15449:0:(genops.c:885:class_export_put()) final put ffff998874b56800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788625291.076045:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788625291.076050:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625291.076055:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788625291.076058:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff99887cb1b380) has no exports 00000020:00000080:2.0:1788625291.076065:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a0f1 00000020:00000080:2.0:1788625291.076069:0:15449:0:(genops.c:885:class_export_put()) final put ffff9987424e6000/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788625291.076415:0:15449:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788625291.076418:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788625291.076420:0:15449:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1788625291.076424:0:15449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788625291.076425:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788625291.076448:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625291.076453:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788625291.076465:0:15449:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788625291.076471:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79f54 00000020:00000080:2.0:1788625291.076475:0:15449:0:(genops.c:885:class_export_put()) final put ffff99887b64f000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788625291.076489:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788625291.076492:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625291.076495:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788625291.076498:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9988739499c0) has no exports 00000020:00000080:2.0:1788625291.076502:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79f4d 00000020:00000080:2.0:1788625291.076505:0:15449:0:(genops.c:885:class_export_put()) final put ffff99887393d800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788625291.076773:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887cb8a000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788625291.076782:0:38:0:(genops.c:885:class_export_put()) final put ffff99887f88f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788625291.076784:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887f88f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788625291.076791:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788625291.076872:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff998874b56800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788625291.076877:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9987424e6000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788625291.076881:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9987424e0800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788625291.076885:0:38:0:(genops.c:885:class_export_put()) final put ffff9987424e3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788625291.076887:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9987424e3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788625291.076890:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788625291.076918:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b64f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788625291.076922:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887393d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788625291.086991:0:15449:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788625291.087009:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788625291.087013:0:15449:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788625291.087022:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788625291.087069:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625291.087080:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788625291.087112:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625291.087115:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788625291.087121:0:15449:0:(genops.c:885:class_export_put()) final put ffff99887393f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788625291.087127:0:15449:0:(genops.c:844:class_export_destroy()) destroying export ffff99887393f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788625291.087135:0:15449:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788625291.087320:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79f38 00000020:00000080:0.0:1788625291.087328:0:15449:0:(genops.c:885:class_export_put()) final put ffff99886c3a9800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788625291.087333:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788625291.087337:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625291.087342:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788625291.087346:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff998873948000) has no exports 00000020:00000080:0.0:1788625291.087364:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625291.087367:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788625291.087371:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79f3f 00000020:00000080:0.0:1788625291.087374:0:15449:0:(genops.c:885:class_export_put()) final put ffff99886c3ac000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788625291.087382:0:15449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99886c323000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788625291.087385:0:15449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99886c323000 2 00000020:01000004:0.0:1788625291.087388:0:15449:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99886c323000 from lustre-MDT0001 00000020:00000080:0.0:1788625291.087405:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625291.087409:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788625291.087411:0:15449:0:(genops.c:885:class_export_put()) final put ffff99887393b800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788625291.087414:0:15449:0:(genops.c:844:class_export_destroy()) destroying export ffff99887393b800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788625291.087421:0:15449:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788625291.087448:0:15449:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788625291.087451:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788625291.087454:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625291.087463:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788625291.087470:0:15449:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff99887c874800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788625291.087476:0:15449:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9988449d0000) has exports, disconnecting them 00000020:00080000:0.0:1788625291.087480:0:15449:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff99887c874800), last request at 1788625065 00000020:00000080:0.0:1788625291.087483:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79f93 00000020:00080000:0.0:1788625291.087496:0:15449:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99887c874800): rc 0 00000020:00000080:0.0:1788625291.087500:0:15449:0:(genops.c:885:class_export_put()) final put ffff99887c874800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788625291.088253:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887393c800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788625291.088263:0:38:0:(genops.c:885:class_export_put()) final put ffff9988749d7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788625291.088265:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9988749d7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788625291.088276:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788625291.088393:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99886c3a9800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788625291.088397:0:38:0:(genops.c:885:class_export_put()) final put ffff99887393a000/lustre-MDD0001_UUID 00000020:00000080:1.0:1788625291.088399:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887393a000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788625291.088402:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788625291.088724:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99886c3ac000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788625291.088729:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887c874800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788625291.088761:0:15449:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788625291.088764:0:15449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788625291.088768:0:15449:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788625291.088772:0:15449:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788625291.088786:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887c875800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788625291.088910:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788625291.088916:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788625291.088925:0:15449:0:(genops.c:885:class_export_put()) final put ffff99887c870000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788625291.088928:0:15449:0:(genops.c:844:class_export_destroy()) destroying export ffff99887c870000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788625291.088931:0:15449:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788625291.088956:0:15449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99886c323000 1 00000020:00000080:1.0:1788625291.088959:0:15449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79ecf 00000020:00000080:1.0:1788625291.088965:0:15449:0:(genops.c:885:class_export_put()) final put ffff99887b648000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788625291.088972:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788625291.088977:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b648000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788625291.088984:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625291.088987:0:15449:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788625291.088990:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff99885e62b380) has no exports 00000020:00000080:0.0:1788625291.261847:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625291.261863:0:15449:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788625291.261868:0:15449:0:(genops.c:885:class_export_put()) final put ffff99886c324800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788625291.261873:0:15449:0:(genops.c:844:class_export_destroy()) destroying export ffff99886c324800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788625291.261886:0:15449:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788625291.262772:0:15449:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99886c326800 00000020:01000000:0.0:1788625291.262796:0:15449:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788625291.262802:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625291.262806:0:15449:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788625291.262810:0:15449:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff99885ee519c0) has no exports 00000100:00100000:3.0:1788625291.269289:0:6512:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff998872681800:6512] 1 exiting: rc = 0 00000100:00100000:3.0:1788625291.269489:0:6511:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff998851ebd000:6511] 0 exiting: rc = 1 00000100:00100000:0.0:1788625291.273098:0:9824:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff998742e92400:9824] 3 exiting: rc = 0 00000100:00100000:2.0:1788625291.288151:0:6513:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff998851c55a00:6513] 2 exiting: rc = 0 00000100:00100000:1.0:1788625291.289937:0:11318:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff998866fa1400:11318] 4 exiting: rc = 0 00000100:00100000:2.0:1788625291.305912:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.305924:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.305930:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.305936:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.305941:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.305947:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.305953:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.305959:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.305964:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.305969:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.305974:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.305979:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.305985:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.305990:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.305996:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306002:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306006:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306011:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306016:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306022:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306027:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306033:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306050:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306057:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306063:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306068:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306074:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306092:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306098:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306102:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306108:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306113:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306120:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306125:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306130:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306136:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306141:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306147:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306155:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306160:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306166:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306172:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306179:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306186:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306191:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306197:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306202:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306209:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306214:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306220:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306226:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306231:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306237:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306242:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306248:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306255:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306260:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306265:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306270:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306275:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306281:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306285:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306298:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.306304:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.310379:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff998843b41c00:6515] 1 exiting: rc = 0 00000100:00100000:2.0:1788625291.310473:0:6514:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff998872681000:6514] 0 exiting: rc = 1 00000100:00100000:3.0:1788625291.310707:0:12000:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff99874274ea00:12000] 2 exiting: rc = 0 00000100:00100000:0.0:1788625291.316296:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316310:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316317:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316324:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316330:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316336:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316342:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316348:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316354:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316361:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316366:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316374:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316381:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316386:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316404:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316409:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316414:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316420:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316425:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316430:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316435:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316440:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316446:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316452:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316458:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316464:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316470:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316475:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316480:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316485:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316491:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316496:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316502:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316507:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316512:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316545:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316551:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316557:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316562:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316567:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316572:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316577:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316582:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316587:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316592:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316605:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316612:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316617:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316632:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316644:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316649:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316654:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316661:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316668:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316673:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316678:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316683:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316687:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316692:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316697:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.316701:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.317027:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.317032:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.317038:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625291.322222:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff998872680400:6516] 0 exiting: rc = 1 00000100:00100000:2.0:1788625291.328098:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff998860844200:6517] 1 exiting: rc = 0 00000100:00100000:3.0:1788625291.328960:0:14517:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff998861fa1200:14517] 2 exiting: rc = 0 00000100:00100000:2.0:1788625291.329418:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329427:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329433:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329447:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329455:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329460:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329465:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329470:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329478:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329486:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329493:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329499:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329506:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329511:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329543:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329551:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329572:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329579:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329587:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.329593:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330078:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330086:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330095:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330104:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330110:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330115:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330120:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330127:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330151:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330159:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330177:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330183:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330190:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330196:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330202:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330208:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330214:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330220:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330226:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330233:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330255:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330263:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330269:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330276:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330285:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330293:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330299:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330307:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330314:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330320:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330326:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330333:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330354:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330361:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330367:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330372:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330379:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330384:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330390:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330395:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330401:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330407:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330412:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625291.330417:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1788625291.343739:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625291.350213:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff998851c2fa00:6518] 0 exiting: rc = 1 00000100:00100000:0.0:1788625291.350585:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff998846860400:6519] 1 exiting: rc = 0 00000100:00100000:1.0:1788625291.351280:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351289:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351295:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351301:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351307:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351315:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351320:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351333:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351340:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351346:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351352:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351359:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351364:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351370:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351377:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351383:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351390:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351396:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351403:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351408:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351427:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351432:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351438:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351445:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351450:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351456:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351462:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351467:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351472:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351478:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351485:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351491:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351497:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351502:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351509:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351544:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351551:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351557:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351562:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351566:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351572:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351577:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351583:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351588:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351606:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351611:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351617:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351634:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351639:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351644:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351650:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351655:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351662:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351668:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351675:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351689:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351695:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351702:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351718:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351724:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351730:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351737:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351742:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.351747:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.352551:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99885833e400:6521] 1 exiting: rc = 0 00000100:00100000:0.0:1788625291.352713:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff998848a1a400:6520] 0 exiting: rc = 1 00000100:00100000:1.0:1788625291.353229:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353236:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353240:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353245:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353251:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353256:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353262:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353267:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353272:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353276:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353281:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353286:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353291:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353296:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353301:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353306:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353310:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353315:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353320:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353325:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353330:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353335:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353340:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353344:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353349:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353353:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353369:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353374:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353379:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353384:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353388:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353393:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353398:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353403:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353410:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353416:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353421:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353426:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353431:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353436:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353441:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353447:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353452:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353458:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353463:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353468:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353475:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353480:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353485:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353489:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353494:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353499:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353505:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353510:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353540:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353547:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353552:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353558:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353563:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353568:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353573:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353603:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353610:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.353616:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625291.358479:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff998846861e00:6523] 1 exiting: rc = 0 00000100:00100000:0.0:1788625291.358687:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff99885ec37200:6522] 0 exiting: rc = 1 00000100:00100000:1.0:1788625291.358833:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358841:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358847:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358852:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358859:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358865:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358871:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358876:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358881:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358887:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358892:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358898:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358905:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358910:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358916:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358921:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358927:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358932:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358937:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358941:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358946:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358952:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358957:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358963:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358968:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358973:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358979:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358984:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358989:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358994:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.358999:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359004:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359030:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359036:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359042:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359048:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359053:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359058:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359064:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359070:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359075:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359081:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359086:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359091:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359096:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359102:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359107:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359112:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359116:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359121:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359127:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359132:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359136:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359141:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359146:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359151:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359157:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359162:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359168:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359173:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359178:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359183:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359189:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.359194:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.360649:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff99885ec37000:6526] 2 exiting: rc = 0 00000100:00100000:1.0:1788625291.360940:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff998866f8be00:6524] 0 exiting: rc = 1 00000100:00100000:2.0:1788625291.364228:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff998866f8bc00:6525] 1 exiting: rc = 0 00000100:00100000:1.0:1788625291.364479:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364496:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364514:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364540:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364546:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364552:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364559:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364565:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364572:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364578:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364586:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364605:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364611:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364617:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364636:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364642:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364648:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364654:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364662:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364685:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364693:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364699:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364716:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364723:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364728:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364734:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364740:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364747:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364763:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364771:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364776:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364782:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364788:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364793:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364801:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364808:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364824:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364831:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364838:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364843:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364848:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364855:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364862:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364884:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364892:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364899:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364907:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364913:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364919:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364925:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364933:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364940:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364946:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364952:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364957:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364963:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364970:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364977:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364983:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364988:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.364994:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.365000:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.365005:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625291.365011:0:15449:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788625291.382549:0:15449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788625291.382564:0:15449:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788625291.382570:0:15449:0:(genops.c:885:class_export_put()) final put ffff998844c23800/MDS_uuid 00000020:00000080:1.0:1788625291.382575:0:15449:0:(genops.c:844:class_export_destroy()) destroying export ffff998844c23800/MDS_uuid for MDS 00000020:01000000:1.0:1788625291.382584:0:15449:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788625291.383004:0:15449:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788625292.370046:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625293.387791:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625294.411749:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788625295.116044:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6544f02a-cd81-4e03-84c5-408bee21ab7a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788625295.116055:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6544f02a-cd81-4e03-84c5-408bee21ab7a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625295.116057:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788625295.116061:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788625295.116065:0:38:0:(import.c:65:import_set_state_nolock()) ffff9988749d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625295.116075:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 411 00000100:00080000:0.0:1788625295.116081:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788625295.116088:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9988749d4800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625295.116143:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998744829c00 x1875509206220800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625295.116212:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788625295.116216:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788625295.116218:0:38:0:(import.c:65:import_set_state_nolock()) ffff99887cb8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625295.116222:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 411 00000100:00080000:0.0:1788625295.116225:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788625295.116228:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99887cb8f800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625295.116241:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874482ad80 x1875509206221056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625295.116277:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206220800:0@lo:38:kworker.0 00000400:00000100:0.0:1788625295.116328:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875509206220800 offset 0 length 520: 4 00000100:00100000:0.0:1788625295.116384:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206221056:0@lo:38:kworker.0 00000400:00000100:0.0:1788625295.116402:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875509206221056 offset 0 length 520: 4 00000100:00100000:0.0:1788625295.116438:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206220928:0@lo:400:kworker.0 00000400:00000100:0.0:1788625295.116476:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875509206220928 offset 0 length 224: 4 00000100:00100000:0.0:1788625295.116507:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625295.116539:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206221184:0@lo:400:kworker.0 00000400:00000100:0.0:1788625295.116572:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875509206221184 offset 0 length 224: 4 00000020:01000004:0.0:1788625295.217476:0:15650:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788625295.245953:0:15650:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788625295.246009:0:15650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a313 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625295.246025:0:15650:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a313 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625295.246032:0:15650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a313 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625295.246039:0:15650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a313 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625295.246068:0:15650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788625295.246073:0:15650:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788625295.246108:0:15650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788625295.246121:0:15650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff998744829c00 x1875509206220800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788625310 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625295.246147:0:15650:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788625295.246167:0:15650:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788625295.246175:0:15650:0:(import.c:65:import_set_state_nolock()) ffff9988749d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788625295.246180:0:15650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788625295.246185:0:15650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff998744829c00 x1875509206220800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788625310 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625295.246191:0:15650:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788625295.246194:0:15650:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788625295.246259:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206220800:0@lo:38:kworker.0 00000100:00080000:3.0:1788625295.247392:0:15650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788625295.247403:0:15650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff998744828e00 x1875509206220928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625311 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788625295.247494:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625295.247501:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a313 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625295.247510:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682c00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625295.247514:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a313 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625295.247562:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7a313 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625295.247569:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7a313 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625295.247574:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788625295.247576:0:10330:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788625295.247579:0:10330:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788625295.247592:0:10330:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9988582ef800 00010000:00010000:0.0:1788625295.247596:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7a313 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625295.247602:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7a30c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7a313 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625295.247614:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625295.247616:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625295.247618:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625295.247952:0:15650:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788625295.247958:0:15650:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788625295.247979:0:15650:0:(import.c:65:import_set_state_nolock()) ffff998741e0a800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788625295.248633:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875509206221312:0@lo:39:umount.0 00000400:00000100:0.0:1788625295.248687:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875509206221312 offset 0 length 224: 4 00000100:00100000:1.0:1788625295.251832:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206220928:0@lo:400:kworker.0 00010000:00010000:3.0:1788625295.437828:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625296.459714:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788625296.656698:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788625296.656707:0:8419:0:(genops.c:885:class_export_put()) final put ffff998741e0a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788625296.656931:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff998741e0a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788625296.656987:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998741e08800 for lustre-OST0000 00000001:00100000:2.0:1788625296.657619:0:9503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788625296.657623:0:9503:0:(genops.c:885:class_export_put()) final put ffff99885ee8d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788625296.657690:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99885ee8d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788625296.657730:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99885ee89800 for lustre-OST0001 00010000:00010000:0.0:1788625297.483883:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625298.508183:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625299.531911:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788625300.235661:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6544f02a-cd81-4e03-84c5-408bee21ab7a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788625300.235674:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6544f02a-cd81-4e03-84c5-408bee21ab7a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625300.235678:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788625300.235707:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788625300.236368:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206221440:0@lo:400:kworker.0 00000400:00000100:1.0:1788625300.236451:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875509206221440 offset 0 length 224: 4 00000100:00100000:0.0:1788625300.364903:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625290/real 1788625290] req@ffff998744079c00 x1875509206220416/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788625300 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625300.364960:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998744079c00 x1875509206220416/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788625300 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788625300.364984:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9988582ef800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625300.365015:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788625300.365019:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6544f02a-cd81-4e03-84c5-408bee21ab7a:3634:1875509206220416:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1788625300.365247:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6544f02a-cd81-4e03-84c5-408bee21ab7a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788625300.365253:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788625300.365256:0:37:0:(import.c:65:import_set_state_nolock()) ffff9988582ef800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625300.365261:0:37:0:(import.c:545:import_select_connection()) MGC192.168.204.114@tcp: connect to NID 0@lo last attempt 411 00000100:00080000:3.0:1788625300.365266:0:37:0:(import.c:630:import_select_connection()) MGC192.168.204.114@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788625300.365273:0:37:0:(import.c:665:import_select_connection()) MGC192.168.204.114@tcp: import ffff9988582ef800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625300.365308:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9987442d7480 x1875509206221568/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625300.365355:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788625300.365359:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788625300.365760:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6544f02a-cd81-4e03-84c5-408bee21ab7a:3634:1875509206221568:0@lo:250:kworker.0 00000400:00000100:0.0:1788625300.365886:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875509206221568 offset 0 length 520: 4 00010000:00010000:0.0:1788625300.557477:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625301.579681:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625302.606422:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625303.628115:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625304.652248:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625305.483672:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625295/real 1788625295] req@ffff9987442d5500 x1875509206221312/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788625305 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625305.483777:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9987442d5500 x1875509206221312/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788625305 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788625305.483799:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998741e0a800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788625305.483820:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875509206221312:0@lo:39:umount.0 00000100:00080000:3.0:1788625305.484242:0:15650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788625305.484248:0:15650:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788625305.484253:0:15650:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788625305.485385:0:15650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625305.487894:0:15650:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625305.487906:0:15650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625305.487913:0:15650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625305.487965:0:15650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625305.487973:0:15650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a597 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625305.487980:0:15650:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a597 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625305.487985:0:15650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a597 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625305.488048:0:15650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a597 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625305.488068:0:15650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788625305.488074:0:15650:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788625305.488112:0:15650:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788625305.488117:0:15650:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788625305.488124:0:15650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788625305.488129:0:15650:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788625305.488134:0:15650:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9988449d19c0) has no exports 00000020:00080000:3.0:1788625305.488176:0:15650:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9988449d19c0) has no exports 00010000:00010000:1.0:1788625305.489654:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625305.489666:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625305.489677:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8600 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625305.489682:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625305.489692:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7a321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625305.489700:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7a321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625305.489706:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788625305.489708:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788625305.489711:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788625305.489728:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9988582ef800 00010000:00010000:1.0:1788625305.489731:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7a321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625305.489738:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7a31a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7a321 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625305.489778:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625305.489782:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a597 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625305.489788:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840030600 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625305.489791:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a597 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625305.489798:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7a597 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625305.489804:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7a597 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625305.489808:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788625305.489810:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788625305.489812:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788625305.489817:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9988582ef800 00010000:00010000:1.0:1788625305.489820:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7a597 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625305.489827:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998840030600/0x2d2e3b3f34a7a590 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7a597 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625305.489835:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625305.489837:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625305.489838:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625305.490257:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788625305.491726:0:15650:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998850b2d480 - data ffff998867ad4e58/ffff9987427b7c00 00000020:01000000:3.0:1788625305.491902:0:15650:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9987426be120 - data ffff9988678aae58/ffff99887c9e4800 00100000:10000000:3.0:1788625305.502074:0:15650:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788625305.515009:0:15650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a06c 00000020:00000080:2.0:1788625305.515022:0:15650:0:(genops.c:885:class_export_put()) final put ffff99887b615000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788625305.515050:0:15650:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998878127800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788625305.515054:0:15650:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998878127800 2 00000020:01000004:2.0:1788625305.515058:0:15650:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff998878127800 from lustre-OST0000 00000020:00000080:2.0:1788625305.515083:0:15650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625305.515092:0:15650:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788625305.515095:0:15650:0:(genops.c:885:class_export_put()) final put ffff99887c877000/lustre-OST0000_UUID 00000020:00000080:2.0:1788625305.515098:0:15650:0:(genops.c:844:class_export_destroy()) destroying export ffff99887c877000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788625305.515105:0:15650:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788625305.515156:0:15650:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788625305.515161:0:15650:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788625305.515165:0:15650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625305.515170:0:15650:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788625305.515178:0:15650:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99887b64a800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788625305.515184:0:15650:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff99887b488000) has exports, disconnecting them 00000020:00080000:2.0:1788625305.515202:0:15650:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99887b64a800), last request at 1788625083 00000020:00000080:2.0:1788625305.515207:0:15650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a096 00000020:00080000:2.0:1788625305.515217:0:15650:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99887b64a800): rc 0 00000020:00000080:2.0:1788625305.515222:0:15650:0:(genops.c:885:class_export_put()) final put ffff99887b64a800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788625305.515297:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b615000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788625305.515314:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b64a800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788625305.516595:0:15650:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788625305.516622:0:15650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788625305.516627:0:15650:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788625305.516633:0:15650:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788625305.516689:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9988749d4800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788625305.516895:0:15650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788625305.516903:0:15650:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788625305.516908:0:15650:0:(genops.c:885:class_export_put()) final put ffff99887ca7d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788625305.516912:0:15650:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca7d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788625305.516917:0:15650:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788625305.516976:0:15650:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788625305.516979:0:15650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625305.516983:0:15650:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788625305.516988:0:15650:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff998741e09800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788625305.516993:0:15650:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff99885e628000) has exports, disconnecting them 00000020:00080000:1.0:1788625305.516998:0:15650:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff998741e09800), last request at 1788625083 00000020:00000080:1.0:1788625305.517002:0:15650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a0ab 00000020:00080000:1.0:1788625305.517013:0:15650:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998741e09800): rc 0 00000020:00000080:1.0:1788625305.517017:0:15650:0:(genops.c:885:class_export_put()) final put ffff998741e09800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788625305.517783:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff998741e09800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788625305.517808:0:15650:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788625305.517811:0:15650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788625305.517814:0:15650:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788625305.517818:0:15650:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788625305.517832:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998741e0a800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788625305.517973:0:15650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625305.517979:0:15650:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788625305.517982:0:15650:0:(genops.c:885:class_export_put()) final put ffff998741e0e000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788625305.517984:0:15650:0:(genops.c:844:class_export_destroy()) destroying export ffff998741e0e000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788625305.517988:0:15650:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788625305.518030:0:15650:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998878127800 1 00000020:00000080:0.0:1788625305.518035:0:15650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a034 00000020:00000080:0.0:1788625305.518039:0:15650:0:(genops.c:885:class_export_put()) final put ffff99887ca7f800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788625305.518046:0:15650:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788625305.518052:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca7f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788625305.518059:0:15650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625305.518062:0:15650:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788625305.518064:0:15650:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff99885e62cd40) has no exports 00000020:00000080:0.0:1788625305.616650:0:15650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625305.616665:0:15650:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788625305.616671:0:15650:0:(genops.c:885:class_export_put()) final put ffff998878123000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788625305.616675:0:15650:0:(genops.c:844:class_export_destroy()) destroying export ffff998878123000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788625305.616688:0:15650:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788625305.616825:0:15650:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff998878124800 00000020:02000400:0.0:1788625305.616941:0:15650:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788625305.685741:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788625305.874473:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6544f02a-cd81-4e03-84c5-408bee21ab7a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788625305.874484:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6544f02a-cd81-4e03-84c5-408bee21ab7a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625305.874487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788625305.874490:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788625305.874598:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206221696:0@lo:400:kworker.0 00000400:00000100:3.0:1788625305.874654:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875509206221696 offset 0 length 224: 4 00010000:00010000:1.0:1788625306.699706:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625307.724947:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625308.779240:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625309.835773:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788625310.526192:0:15853:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788625310.542180:0:15853:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788625310.542282:0:15853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625310.542315:0:15853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625310.542323:0:15853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625310.542331:0:15853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625310.542358:0:15853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788625310.542364:0:15853:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788625310.542388:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788625310.542401:0:15853:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99874482ad80 x1875509206221056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788625310 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625310.542423:0:15853:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788625310.542429:0:15853:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788625310.542437:0:15853:0:(import.c:65:import_set_state_nolock()) ffff99887cb8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788625310.542442:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788625310.542446:0:15853:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99874482ad80 x1875509206221056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788625310 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625310.542452:0:15853:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00010000:00010000:1.0:1788625310.542507:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625310.542530:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625310.542539:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625310.542543:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625310.542553:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206221056:0@lo:38:kworker.0 00010000:00010000:1.0:1788625310.542553:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7a2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625310.542572:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7a2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625310.542578:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788625310.542580:0:10330:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788625310.542582:0:10330:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788625310.542596:0:10330:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9988582ef800 00010000:00010000:1.0:1788625310.542600:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7a2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625310.542607:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7a2f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7a2f7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625310.542617:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625310.542619:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625310.542621:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625310.548812:0:15853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788625310.549838:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788625310.549853:0:15853:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99874482b480 x1875509206221184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625311 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625310.549886:0:15853:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99874482bb80 x1875509206221440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625316 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625310.549908:0:15853:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9987442d5500 x1875509206221696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625321 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625310.549936:0:15853:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788625310.549943:0:15853:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788625310.549975:0:15853:0:(import.c:65:import_set_state_nolock()) ffff99887cb8c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788625310.550036:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206221440:0@lo:400:kworker.0 00000100:00100000:3.0:1788625310.550180:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206221184:0@lo:400:kworker.0 00000100:00100000:3.0:1788625310.550217:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206221696:0@lo:400:kworker.0 00000100:00100000:3.0:1788625310.550257:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875509206221824:0@lo:39:umount.0 00000400:00000100:3.0:1788625310.550305:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875509206221824 offset 0 length 224: 4 00010000:00010000:3.0:1788625310.859746:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788625310.987876:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6544f02a-cd81-4e03-84c5-408bee21ab7a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788625310.987888:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6544f02a-cd81-4e03-84c5-408bee21ab7a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788625311.883818:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625312.909502:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625313.931675:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625314.956786:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625315.659961:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625300/real 1788625300] req@ffff9987442d7480 x1875509206221568/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788625315 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625315.659994:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9987442d7480 x1875509206221568/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788625315 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788625315.660015:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9988582ef800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625315.660041:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788625315.660045:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6544f02a-cd81-4e03-84c5-408bee21ab7a:3634:1875509206221568:0@lo:250:kworker.0 00000100:00080000:2.0:1788625315.660148:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6544f02a-cd81-4e03-84c5-408bee21ab7a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788625315.660154:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788625315.660156:0:38:0:(import.c:65:import_set_state_nolock()) ffff9988582ef800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788625315.660161:0:38:0:(import.c:545:import_select_connection()) MGC192.168.204.114@tcp: connect to NID 0@lo last attempt 421 00000100:00080000:2.0:1788625315.660166:0:38:0:(import.c:630:import_select_connection()) MGC192.168.204.114@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788625315.660172:0:38:0:(import.c:665:import_select_connection()) MGC192.168.204.114@tcp: import ffff9988582ef800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625315.660208:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874427f100 x1875509206221952/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625315.660687:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6544f02a-cd81-4e03-84c5-408bee21ab7a:3634:1875509206221952:0@lo:250:kworker.0 00000400:00000100:3.0:1788625315.660735:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875509206221952 offset 0 length 520: 4 00010000:00010000:1.0:1788625315.984913:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625317.003703:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625318.027771:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625319.054893:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625320.078807:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788625320.718130:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6544f02a-cd81-4e03-84c5-408bee21ab7a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788625320.718141:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6544f02a-cd81-4e03-84c5-408bee21ab7a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788625320.780053:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625310/real 1788625310] req@ffff99874427c700 x1875509206221824/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788625320 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625320.780083:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99874427c700 x1875509206221824/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788625320 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788625320.780104:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887cb8c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788625320.780125:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875509206221824:0@lo:39:umount.0 00000100:00080000:2.0:1788625320.780180:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788625320.780185:0:15853:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788625320.780190:0:15853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788625320.782226:0:15853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a305 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625320.782244:0:15853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a305 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625320.782252:0:15853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a305 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625320.782277:0:15853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a305 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625320.782445:0:15853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625320.782454:0:15853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7a589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625320.782461:0:15853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7a589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625320.782467:0:15853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625320.782473:0:15853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7a589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625320.782499:0:15853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788625320.782504:0:15853:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788625320.782555:0:15853:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788625320.782559:0:15853:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788625320.782564:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625320.782570:0:15853:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788625320.782574:0:15853:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff998742ed0000) has no exports 00000020:00080000:2.0:1788625320.782596:0:15853:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff998742ed0000) has no exports 00010000:00010000:1.0:1788625320.783407:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625320.783416:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a305 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625320.783423:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887cac7a00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625320.783427:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a305 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625320.783450:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7a305 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625320.783457:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7a305 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625320.783463:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788625320.783465:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788625320.783468:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788625320.783481:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9988582ef800 00010000:00010000:1.0:1788625320.783485:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7a305 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625320.783492:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887cac7a00/0x2d2e3b3f34a7a2fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7a305 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625320.783505:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625320.783509:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625320.783514:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683a00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625320.783556:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7a589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625320.783563:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7a589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625320.783570:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7a589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625320.783586:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788625320.783588:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788625320.783590:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788625320.783597:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9988582ef800 00010000:00010000:1.0:1788625320.783600:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7a589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625320.783605:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b683a00/0x2d2e3b3f34a7a582 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7a589 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625320.783620:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625320.783622:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625320.783623:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625320.784419:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788625320.790439:0:15853:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998741e792a0 - data ffff998867b30d80/ffff998850d8b800 00000020:01000000:2.0:1788625320.790609:0:15853:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998851b59c00 - data ffff998867ad3000/ffff998850d8b000 00100000:10000000:2.0:1788625320.809780:0:15853:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788625320.820192:0:15853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a192 00000020:00000080:3.0:1788625320.821539:0:15853:0:(genops.c:885:class_export_put()) final put ffff99887b49b000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788625320.821560:0:15853:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9988449c9000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788625320.821564:0:15853:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9988449c9000 2 00000020:01000004:3.0:1788625320.821567:0:15853:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9988449c9000 from lustre-OST0001 00000020:00000080:3.0:1788625320.821596:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788625320.821606:0:15853:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788625320.821609:0:15853:0:(genops.c:885:class_export_put()) final put ffff99887ca90800/lustre-OST0001_UUID 00000020:00000080:3.0:1788625320.821612:0:15853:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca90800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788625320.821621:0:15853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788625320.821767:0:15853:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6544f02a-cd81-4e03-84c5-408bee21ab7a->MGS 00010000:00010000:3.0:1788625320.821788:0:15853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998840031c00/0x2d2e3b3f34a79eeb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a79ef2 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625320.821801:0:15853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998840031c00/0x2d2e3b3f34a79eeb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a79ef2 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625320.821808:0:15853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788625320.821811:0:15853:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788625320.821814:0:15853:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788625320.821827:0:15853:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9988582ef800 00010000:00010000:3.0:1788625320.821831:0:15853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998840031c00/0x2d2e3b3f34a79eeb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a79ef2 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625320.821849:0:15853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7a367 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625320.821856:0:15853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7a367 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625320.821862:0:15853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788625320.821864:0:15853:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788625320.821875:0:15853:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788625320.821888:0:15853:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9988582ef800 00010000:00010000:3.0:1788625320.821891:0:15853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887c994e00/0x2d2e3b3f34a7a360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7a367 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788625320.821907:0:15853:0:(import.c:65:import_set_state_nolock()) ffff9988582ef800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788625320.821912:0:15853:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788625320.821914:0:15853:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788625320.821915:0:15853:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788625320.821921:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788625320.821931:0:15853:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99874427f100 x1875509206221952/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788625335 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788625320.821950:0:15853:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788625320.821953:0:15853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788625320.822018:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b49b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788625320.822207:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6544f02a-cd81-4e03-84c5-408bee21ab7a:3634:1875509206221952:0@lo:250:kworker.0 10000000:01000000:3.0:1788625320.827628:0:15853:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788625320.827651:0:15853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a79de8 00000020:00000080:3.0:1788625320.827662:0:15853:0:(genops.c:885:class_export_put()) final put ffff9988582ef000/6544f02a-cd81-4e03-84c5-408bee21ab7a 00000020:01000000:3.0:1788625320.827695:0:15853:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.114@tcp (flags='') 00000020:00000080:3.0:1788625320.827706:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788625320.827713:0:15853:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.114@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788625320.827718:0:15853:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff99885ecd99c0) has no exports 00000020:00000080:0.0:1788625320.827776:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9988582ef000/6544f02a-cd81-4e03-84c5-408bee21ab7a for MGC192.168.204.114@tcp 10000000:01000000:1.0:1788625320.828067:0:6508:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788625320.828802:0:15853:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.114@tcp: client import never connected 00000100:00080000:3.0:1788625320.828808:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788625320.828812:0:15853:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788625320.828815:0:15853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788625320.828818:0:15853:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788625320.828870:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788625320.828877:0:15853:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.114@tcp (uuid 6544f02a-cd81-4e03-84c5-408bee21ab7a) 00000020:01000000:3.0:1788625320.828884:0:15853:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788625320.828888:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788625320.828892:0:15853:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788625320.828898:0:15853:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99887cb8e000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788625320.828914:0:15853:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff99887cb1cd40) has exports, disconnecting them 00000020:00080000:3.0:1788625320.828919:0:15853:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99887cb8e000), last request at 1788625102 00000020:00000080:3.0:1788625320.828923:0:15853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a1bc 00000020:00080000:3.0:1788625320.828936:0:15853:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99887cb8e000): rc 0 00000020:00000080:3.0:1788625320.828940:0:15853:0:(genops.c:885:class_export_put()) final put ffff99887cb8e000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788625320.829014:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9988582ef800 for MGC192.168.204.114@tcp 00000020:00000080:0.0:1788625320.829022:0:38:0:(genops.c:885:class_export_put()) final put ffff9988582eb800/6544f02a-cd81-4e03-84c5-408bee21ab7a 00000020:00000080:0.0:1788625320.829035:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9988582eb800/6544f02a-cd81-4e03-84c5-408bee21ab7a for MGC192.168.204.114@tcp 00000020:01000000:0.0:1788625320.829040:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.114@tcp (6544f02a-cd81-4e03-84c5-408bee21ab7a) 00000020:00000080:0.0:1788625320.829321:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887cb8e000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788625320.861599:0:15853:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788625320.861609:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788625320.861613:0:15853:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788625320.861620:0:15853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788625320.861824:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625320.861834:0:15853:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788625320.861841:0:15853:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788625320.861850:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625320.861854:0:15853:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788625320.861862:0:15853:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff99887ca97800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788625320.861868:0:15853:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff99887cb18000) has exports, disconnecting them 00000020:00080000:0.0:1788625320.861872:0:15853:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff99887ca97800), last request at 1788625102 00000020:00000080:0.0:1788625320.861877:0:15853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a1d1 00000020:00080000:0.0:1788625320.861894:0:15853:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99887ca97800): rc 0 00000020:00000080:0.0:1788625320.861900:0:15853:0:(genops.c:885:class_export_put()) final put ffff99887ca97800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788625320.862604:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887cb8f800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788625320.862613:0:38:0:(genops.c:885:class_export_put()) final put ffff99887cb8f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788625320.862617:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887cb8f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788625320.862632:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788625320.862700:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca97800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788625320.862721:0:15853:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788625320.862725:0:15853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788625320.862728:0:15853:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788625320.862733:0:15853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788625320.862749:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887cb8c800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788625320.866387:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788625320.866798:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788625320.874855:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788625320.875022:0:8440:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff998741da3000:8440] 2 exiting: rc = 0 00000100:00100000:1.0:1788625320.875413:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff998844c56200:6495] 1 exiting: rc = 0 00000100:00100000:3.0:1788625320.878874:0:6494:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff998844c57800:6494] 0 exiting: rc = 1 00000100:00100000:1.0:1788625320.887557:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.890235:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff998866f3d600:6497] 1 exiting: rc = 0 00000100:00100000:3.0:1788625320.891716:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99887807b800:6496] 0 exiting: rc = 1 00000100:00100000:2.0:1788625320.893486:0:10331:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9987439f4000:10331] 4 exiting: rc = 0 00000100:00100000:0.0:1788625320.893487:0:9513:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff998742ea5e00:9513] 3 exiting: rc = 0 00000100:00100000:0.0:1788625320.900646:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff998866f3ca00:6498] 2 exiting: rc = 0 00000100:00100000:1.0:1788625320.901339:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901349:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901359:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901368:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901377:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901388:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901423:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901430:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901437:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901443:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901448:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901453:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901460:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901466:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901471:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901478:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901483:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901490:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901495:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901501:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901507:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901511:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901531:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901537:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901542:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901548:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901555:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901562:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901583:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901681:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901686:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901691:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901711:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901716:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901722:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901728:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901733:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901738:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901742:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901747:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901752:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901756:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901761:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901766:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901771:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901775:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901781:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901786:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901806:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901813:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901818:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901823:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901828:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901833:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901838:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901843:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901847:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901852:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901856:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901861:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901866:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901871:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901875:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625320.901880:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788625320.903241:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788625320.903256:0:15853:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788625320.903262:0:15853:0:(genops.c:885:class_export_put()) final put ffff99887ca90000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788625320.903278:0:15853:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca90000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788625320.903286:0:15853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788625320.903344:0:15853:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9988449c9000 1 00000020:00000080:1.0:1788625320.903352:0:15853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7a161 00000020:00000080:1.0:1788625320.903361:0:15853:0:(genops.c:885:class_export_put()) final put ffff99887ca91800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788625320.903375:0:15853:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788625320.903389:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca91800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788625320.903402:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625320.903407:0:15853:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788625320.903411:0:15853:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff99887b48b380) has no exports 00000020:00000080:0.0:1788625320.970349:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625320.970363:0:15853:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788625320.970369:0:15853:0:(genops.c:885:class_export_put()) final put ffff998844c25000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788625320.970373:0:15853:0:(genops.c:844:class_export_destroy()) destroying export ffff998844c25000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788625320.970379:0:15853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788625320.971510:0:15853:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff998873939800 00000020:01000000:0.0:1788625320.971611:0:15853:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788625320.971616:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625320.971621:0:15853:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788625320.971625:0:15853:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff99887394cd40) has no exports 00000020:00000080:0.0:1788625320.971653:0:15853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625320.971660:0:15853:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788625320.971663:0:15853:0:(genops.c:885:class_export_put()) final put ffff99887ca7b800/OSS_uuid 00000020:00000080:0.0:1788625320.971665:0:15853:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca7b800/OSS_uuid for OSS 00000020:01000000:0.0:1788625320.971669:0:15853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1788625320.971823:0:6507:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788625320.972044:0:8868:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff99887c89fe00:8868] 3 exiting: rc = 0 00000100:00100000:1.0:1788625320.975545:0:8424:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff99887b67cc00:8424] 1 exiting: rc = 0 00000100:00100000:2.0:1788625320.975934:0:8425:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff99884496ae00:8425] 2 exiting: rc = 0 00000100:00100000:0.0:1788625320.975938:0:8423:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff99887b67c600:8423] 0 exiting: rc = 1 00000100:00100000:2.0:1788625320.976877:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976887:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976893:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976901:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976909:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976914:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976920:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976926:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976931:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976938:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976944:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976950:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976955:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976960:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976965:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976970:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976976:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976981:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976986:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976991:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.976996:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977001:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977006:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977011:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977016:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977038:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977045:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977050:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977055:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977060:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977065:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977070:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977075:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977080:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977099:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977104:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977109:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977114:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977119:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977125:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977130:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977137:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977142:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977149:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977154:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977160:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977165:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977170:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977175:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977181:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977186:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977191:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977196:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977201:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977206:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977212:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977219:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977226:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977231:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977236:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977241:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977256:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977269:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.977280:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.978160:0:10091:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9987437c2000:10091] 2 exiting: rc = 0 00000100:00100000:1.0:1788625320.978287:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99887c8f6600:8428] 1 exiting: rc = 0 00000100:00100000:0.0:1788625320.980162:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99887b67fe00:8427] 0 exiting: rc = 1 00000100:00100000:2.0:1788625320.981392:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981400:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981407:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981412:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981431:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981437:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981443:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981488:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981495:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981500:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981505:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981510:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981533:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981539:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981545:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981550:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981555:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981559:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981564:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981569:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981575:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981580:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981586:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981592:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981599:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.981605:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982311:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982317:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982322:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982327:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982332:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982336:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982341:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982345:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982351:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982356:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982360:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982366:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982371:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982386:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982392:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982396:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982401:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982406:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982410:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982416:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982421:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982425:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982431:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982436:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982441:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982447:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982452:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982456:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982461:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982466:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982471:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982475:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982480:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982485:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982492:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982497:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982502:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.982507:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.984738:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff998851c31200:8430] 1 exiting: rc = 0 00000100:00100000:2.0:1788625320.984968:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff998851c31e00:8429] 0 exiting: rc = 1 00000100:00100000:2.0:1788625320.989552:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9988449a8400:8431] 2 exiting: rc = 0 00000100:00100000:2.0:1788625320.989705:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989713:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989719:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989725:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989731:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989737:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989818:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989825:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989831:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989836:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989842:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989848:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989853:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989859:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989865:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989876:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989892:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989898:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989905:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989910:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989916:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989921:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989926:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989931:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989936:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989941:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989946:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989952:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989957:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989962:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989968:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989973:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989978:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989984:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989989:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.989995:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.990000:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.990006:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.990012:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.990039:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.990046:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.990056:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.990061:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.990067:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.990072:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.990078:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.990084:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993293:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993302:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993308:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993318:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993325:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993330:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993335:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993340:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993347:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993362:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993377:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993383:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993389:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993395:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993401:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993406:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625320.993419:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625321.007665:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99887b604000:8432] 0 exiting: rc = 1 00000100:00100000:1.0:1788625321.007923:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99887807ac00:8433] 1 exiting: rc = 0 00000100:00100000:3.0:1788625321.008093:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008101:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008107:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008112:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008116:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008122:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008127:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008132:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008138:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008194:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008199:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008204:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008208:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008214:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008219:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008224:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008230:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008235:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008242:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008247:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008264:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008271:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008276:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008294:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008300:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008306:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008311:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008316:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008322:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008327:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008332:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008337:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008343:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008348:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008354:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008358:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008364:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008368:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008373:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008378:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008383:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008388:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008393:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008398:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008403:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008409:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008414:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008418:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008424:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008429:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008434:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008438:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008443:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008447:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008452:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008457:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008461:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008465:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008476:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008481:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008486:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008491:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008495:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.008501:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.012702:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff998874b36c00:8434] 0 exiting: rc = 1 00000100:00100000:0.0:1788625321.015382:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff998874b37c00:8435] 1 exiting: rc = 0 00000100:00100000:3.0:1788625321.015597:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015618:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015633:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015640:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015646:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015653:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015659:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015666:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015672:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015677:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015684:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015689:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015696:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015702:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015723:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015730:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015736:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015742:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015748:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015755:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015762:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015768:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015773:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015787:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015795:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015801:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015809:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015815:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015848:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015857:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015863:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015869:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015875:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.015881:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017752:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017765:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017772:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017779:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017785:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017790:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017817:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017825:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017833:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017839:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017846:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017852:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017858:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017866:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017872:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017878:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017885:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017891:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017911:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017919:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017925:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017930:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017937:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017943:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017950:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017956:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017963:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017968:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017976:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625321.017993:0:15853:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788625321.036270:0:15853:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788625340.904175:0:16618:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788625351.995876:0:17218:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788625351.995882:0:17218:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788625351.995883:0:17218:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788625351.995984:0:17218:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff998848aae000 00000020:01000004:0.0:1788625351.995999:0:17218:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788625351.996006:0:17218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788625351.996020:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99887cb1b380) 00000020:00000080:0.0:1788625351.996033:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788625352.047106:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788625352.047666:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.049254:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788625352.051423:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.051727:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.052012:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.052306:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.052554:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.052746:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.053026:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.053292:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.053642:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.053827:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.054103:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.054371:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.054640:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.054824:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.055084:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.055385:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.055615:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.055832:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.056110:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.056413:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.056645:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.056874:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.057179:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.057440:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.058026:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.058279:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.058615:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.058862:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.059107:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.059504:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.059810:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788625352.060303:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788625352.062365:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788625352.063868:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788625352.064324:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788625352.064610:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788625352.064806:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788625352.065323:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788625352.067045:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788625352.067427:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788625352.068434:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788625352.072122:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788625352.072975:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788625352.073313:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788625352.073772:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788625352.074853:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788625352.075184:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788625352.076059:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788625352.076370:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788625352.076733:0:17218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1788625352.077647:0:17218:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788625352.077845:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788625352.077853:0:17218:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788625352.077866:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7b3a5 00000020:01000004:2.0:1788625352.077873:0:17218:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788625352.077878:0:17218:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788625352.077883:0:17218:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998848aae000 from MGS 00000020:01000004:2.0:1788625352.077887:0:17218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788625352.077905:0:17218:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99887b4899c0) 00000020:00000080:2.0:1788625352.077916:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788625352.077991:0:17218:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998848aae000 from MGS, refs=2 00080000:01000000:2.0:1788625352.077997:0:17218:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788625352.078002:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7b3b3 00000100:00100000:2.0:1788625352.078101:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788625352.078228:0:17218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788625352.078234:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788625352.079677:0:17218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788625352.079688:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788625352.080228:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625352.080579:0:17218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788625352.080585:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788625352.081670:0:17218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788625352.081679:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788625352.082137:0:17218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788625352.082144:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788625352.083609:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625352.083614:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625352.083615:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625352.084274:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625352.084276:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625352.084278:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625352.084981:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788625352.088636:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788625352.089830:0:17218:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788625352.095950:0:17230:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788625352.096084:0:17218:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788625352.096152:0:17218:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788625352.098086:0:17218:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788625352.098438:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625352.098662:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788625352.098668:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788625352.105410:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788625352.105421:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788625352.106007:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788625352.106014:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788625352.106846:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788625352.106866:0:17218:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.114@tcp' 00000020:01000004:0.0:1788625352.106868:0:17218:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788625352.106897:0:17218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.114@tcp (typ=mgc) 00000020:00000080:0.0:1788625352.106911:0:17218:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.114@tcp (ffff99887cb18000) 00000020:00000080:0.0:1788625352.106927:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788625352.107019:0:17218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998878127800@MGC192.168.204.114@tcp: add connection 192.168.204.114@tcp at head 00010000:00010000:0.0:1788625352.107295:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.114@tcp-0 is initialized 00000040:01000000:0.0:1788625352.107302:0:17218:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.114@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788625352.107794:0:17236:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788625352.107860:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.114@tcp (uuid 097bbbb0-568c-46a3-88ad-c1c4a94e09ad) 00000020:00000080:1.0:1788625352.107876:0:17218:0:(genops.c:1385:class_connect()) connect: client 097bbbb0-568c-46a3-88ad-c1c4a94e09ad, cookie 0x2d2e3b3f34a7b3c1 00000100:00080000:1.0:1788625352.107885:0:17218:0:(import.c:545:import_select_connection()) MGC192.168.204.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788625352.107895:0:17218:0:(import.c:665:import_select_connection()) MGC192.168.204.114@tcp: import ffff998878127800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625352.107939:0:17218:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998744079880 x1875509206222080/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788625352.107965:0:17218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 097bbbb0-568c-46a3-88ad-c1c4a94e09ad->MGS 00000020:01000004:1.0:1788625352.107985:0:17218:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788625352.107990:0:17218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788625352.108000:0:17218:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9988449d0000) 00000020:00000080:1.0:1788625352.108009:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788625352.109059:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3634:1875509206222080:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788625352.109133:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625352.109288:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206222080 00000100:00100000:0.0:1788625352.109296:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206222080 00000100:00100000:0.0:1788625352.109337:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625352.109346:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3634:x1875509206222080:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788625352.109373:0:17233:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 097bbbb0-568c-46a3-88ad-c1c4a94e09ad@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:0.0:1788625352.109410:0:17233:0:(genops.c:1385:class_connect()) connect: client 097bbbb0-568c-46a3-88ad-c1c4a94e09ad, cookie 0x2d2e3b3f34a7b3cf 00000100:00080000:0.0:1788625352.109561:0:17233:0:(import.c:65:import_set_state_nolock()) ffff998878125800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625352.109611:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+5:3634:x1875509206222080:12345-0@lo:250:mount.lustre.0 Request processed in 264us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625352.109619:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625352.109659:0:3634:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788625352.109667:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.114@tcp: connect to target with instance 0 00000100:00080000:0.0:1788625352.109674:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788625352.109678:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788625352.109681:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998878127800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788625352.109683:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788625352.109690:0:3634:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788625352.109695:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3634:1875509206222080:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1788625352.112444:0:17235:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1788625352.132282:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625352.133599:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788625352.133607:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788625352.135067:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788625352.135077:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788625352.135422:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788625352.135428:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788625352.137383:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625352.137628:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788625352.137635:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788625352.138373:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788625352.138380:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788625352.176108:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625352.176379:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788625352.176386:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788625352.177896:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788625352.177907:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788625352.178894:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625352.179147:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788625352.179228:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788625352.180144:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788625352.180152:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788625352.180770:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625352.180971:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788625352.180976:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788625352.181467:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788625352.181473:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788625352.182037:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625352.182172:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788625352.182184:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788625352.182850:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788625352.182863:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788625352.202738:0:17218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625352.203102:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788625352.203111:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788625352.205411:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788625352.205425:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788625352.206762:0:17218:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788625352.206772:0:17218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788625352.208301:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788625352.208333:0:17218:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788625352.208340:0:17218:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788625352.208458:0:17218:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.114@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788625352.208501:0:17218:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.114@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788625352.208505:0:17218:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788625352.208506:0:17218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625352.208508:0:17218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625352.208509:0:17218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625352.208511:0:17218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625352.208512:0:17218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625352.208513:0:17218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625352.208702:0:17218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625352.208704:0:17218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625352.208705:0:17218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788625352.208708:0:17218:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788625352.208710:0:17218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788625352.208711:0:17218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625352.208712:0:17218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625352.208713:0:17218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625352.208714:0:17218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625352.208715:0:17218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625352.208716:0:17218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625352.208718:0:17218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625352.208719:0:17218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625352.208720:0:17218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788625352.208886:0:17218:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788625352.208909:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206222208:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788625352.209049:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625352.209130:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738d4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788625352.209244:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206222208 00000100:00100000:3.0:1788625352.209253:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206222208 00000100:00100000:3.0:1788625352.209338:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625352.209348:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+5:17218:x1875509206222208:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788625352.209410:0:17234:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788625352.209413:0:17234:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788625352.209416:0:17234:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788625352.212069:0:17255:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788625352.213309:0:17234:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1788625352.215735:0:17256:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788625352.215743:0:17256:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788625352.215746:0:17256:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788625352.215749:0:17256:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788625352.216479:0:17256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788625352.218707:0:17234:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788625352.218721:0:17234:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788625352.220726:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+5:17218:x1875509206222208:12345-0@lo:253:mount.lustre.0 Request processed in 11372us (11668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625352.220743:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788625352.221095:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206222208:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788625352.221110:0:17218:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788625352.221114:0:17218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788625352.221116:0:17218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788625352.221117:0:17218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625352.221118:0:17218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625352.221120:0:17218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625352.221121:0:17218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625352.221122:0:17218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788625352.221124:0:17218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788625352.221126:0:17218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625352.221127:0:17218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788625352.221146:0:17218:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998848aae000 from lustre-MDT0000 10000000:01000000:1.0:1788625352.221258:0:17218:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788625352.221262:0:17218:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788625352.221266:0:17218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99887cb18000 10000000:01000000:1.0:1788625352.221270:0:17218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788625352.221279:0:17218:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99887cb18000 from 1 10000000:01000000:1.0:1788625352.221282:0:17218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788625352.221322:0:17218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.221334:0:17218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.221352:0:17218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625352.221374:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206222336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788625352.221421:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625352.221460:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738d4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788625352.221510:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206222336 00000100:00100000:0.0:1788625352.221540:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206222336 00000100:00100000:0.0:1788625352.221640:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625352.221649:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+5:17218:x1875509206222336:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625352.221671:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625352.221686:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743ae0c00/0x2d2e3b3f34a7b3dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b3d6 expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625352.221708:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743ae0c00/0x2d2e3b3f34a7b3dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b3d6 expref: 6 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625352.221717:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743ae0c00/0x2d2e3b3f34a7b3dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b3d6 expref: 6 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625352.221725:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae0c00, rc 0) 00000100:00100000:0.0:1788625352.221772:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+6:17218:x1875509206222336:12345-0@lo:101:mount.lustre.0 Request processed in 125us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625352.221778:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788625352.221854:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206222336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625352.221866:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.221875:0:17218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625352.221925:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206222464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788625352.222105:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625352.226383:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738d4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788625352.226514:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206222464 00000100:00100000:3.0:1788625352.226536:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206222464 00000100:00100000:3.0:1788625352.226589:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788625352.226600:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+6:17218:x1875509206222464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625352.226733:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+6:17218:x1875509206222464:12345-0@lo:501:mount.lustre.0 Request processed in 135us (4627us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788625352.226741:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625352.226896:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206222464:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788625352.226938:0:17218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788625352.226955:0:17218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.226966:0:17218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625352.226975:0:17218:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998848aae000 10000000:01000000:1.0:1788625352.226980:0:17218:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788625352.226999:0:17218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff998848aae000 10000000:01000000:1.0:1788625352.227002:0:17218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788625352.227005:0:17218:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff998848aae000 from 1 10000000:01000000:1.0:1788625352.227008:0:17218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788625352.227039:0:17218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.227048:0:17218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.227057:0:17218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625352.227077:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206222592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788625352.227112:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625352.228976:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738d4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788625352.229007:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206222592 00000100:00100000:2.0:1788625352.229016:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206222592 00000100:00100000:2.0:1788625352.229065:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788625352.229075:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+6:17218:x1875509206222592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625352.229088:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625352.229108:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998744188800/0x2d2e3b3f34a7b3eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b3e4 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.229133:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998744188800/0x2d2e3b3f34a7b3eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b3e4 expref: 7 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.229170:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998744188800/0x2d2e3b3f34a7b3eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b3e4 expref: 7 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.229180:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188800, rc 0) 00000100:00100000:2.0:1788625352.229237:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+7:17218:x1875509206222592:12345-0@lo:101:mount.lustre.0 Request processed in 164us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625352.229244:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788625352.229324:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206222592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625352.229341:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3eb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.229351:0:17218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b3eb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625352.229367:0:17218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788625352.229373:0:17218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3eb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.229381:0:17218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3eb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625352.229414:0:17218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788625352.229419:0:17218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788625352.229424:0:17218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff998848aae000 10000000:01000000:1.0:1788625352.229427:0:17218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788625352.229430:0:17218:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788625352.229433:0:17218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788625352.229456:0:17218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.229464:0:17218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.229473:0:17218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625352.229491:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206222720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788625352.232439:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625352.232505:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738d4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788625352.232813:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206222720 00000100:00100000:3.0:1788625352.232822:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206222720 00000100:00100000:3.0:1788625352.232871:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625352.232881:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+7:17218:x1875509206222720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625352.232897:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625352.232917:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998859be8e00/0x2d2e3b3f34a7b3f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b3f2 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625352.232945:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998859be8e00/0x2d2e3b3f34a7b3f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b3f2 expref: 8 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625352.232973:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998859be8e00/0x2d2e3b3f34a7b3f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b3f2 expref: 8 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625352.232983:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be8e00, rc 0) 00000100:00100000:3.0:1788625352.233047:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+8:17218:x1875509206222720:12345-0@lo:101:mount.lustre.0 Request processed in 167us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625352.233053:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788625352.233138:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206222720:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625352.233156:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3f9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.233165:0:17218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b3f9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625352.233810:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206222848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788625352.233848:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625352.233892:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738d4240 going to sleep for 11 seconds 00000100:00100000:3.0:1788625352.233977:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206222848 00000100:00100000:3.0:1788625352.233982:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206222848 00000100:00100000:3.0:1788625352.234021:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625352.234028:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+8:17218:x1875509206222848:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625352.234181:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+9:17218:x1875509206222848:12345-0@lo:501:mount.lustre.0 Request processed in 153us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625352.234188:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625352.234907:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206222848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788625352.234948:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206222976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788625352.234999:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625352.235033:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738d4240 going to sleep for 11 seconds 00000100:00100000:3.0:1788625352.235082:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206222976 00000100:00100000:3.0:1788625352.235087:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206222976 00000100:00100000:3.0:1788625352.235124:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788625352.235132:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+9:17218:x1875509206222976:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625352.235840:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+9:17218:x1875509206222976:12345-0@lo:503:mount.lustre.0 Request processed in 706us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625352.235848:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625352.236312:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206222976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788625352.237664:0:17257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17257:1875509206223104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625352.237729:0:17257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625352.237768:0:17257:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738d4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788625352.237806:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206223104 00000100:00100000:0.0:1788625352.237813:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206223104 00000100:00100000:0.0:1788625352.237862:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625352.237871:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+9:17257:x1875509206223104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625352.238608:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+9:17257:x1875509206223104:12345-0@lo:502:llog_process_th.0 Request processed in 734us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625352.238616:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788625352.238966:0:17257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17257:1875509206223104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625352.238994:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625352.239006:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625352.239008:0:17257:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788625352.239013:0:17257:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788625352.239016:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788625352.239031:0:17257:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9988449d19c0) 00000020:00000080:1.0:1788625352.239046:0:17257:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788625352.239051:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788625352.239144:0:17257:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788625352.239152:0:17257:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7b407 00000020:00000080:1.0:1788625352.239368:0:17257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788625352.239372:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625352.239376:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625352.239377:0:17257:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788625352.239380:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625352.239384:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625352.239385:0:17257:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788625352.239512:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788625352.239836:0:17257:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9988449d3380) 00000020:00000080:1.0:1788625352.239848:0:17257:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788625352.239854:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788625352.239856:0:17257:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788625352.239859:0:17257:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788625352.239864:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788625352.239907:0:17257:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998848aae000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788625352.239919:0:17257:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9988449d4d40) 00000020:00000080:1.0:1788625352.239927:0:17257:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788625352.239972:0:17257:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788625352.239978:0:17257:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7b41c 00000020:00000080:1.0:1788625352.240072:0:17257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788625352.240079:0:17257:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788625352.240083:0:17257:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2d2e3b3f34a7b423 00080000:01000000:1.0:1788625352.240087:0:17257:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788625352.240091:0:17257:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7b42a 00010000:00010000:2.0:1788625352.352426:0:17257:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788625352.355369:0:17257:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1788625352.356145:0:17257:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788625352.357260:0:17257:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99887b48cd40) 00000020:00000080:2.0:1788625352.357280:0:17257:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788625352.357348:0:17257:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788625352.357355:0:17257:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7b438 00000020:00000080:0.0:1788625352.371294:0:17257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788625352.380661:0:17257:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2d2e3b3f34a7b43f 00000020:00000080:2.0:1788625352.384089:0:17257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788625352.384103:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625352.384112:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625352.384114:0:17257:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788625352.384118:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788625352.384121:0:17257:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788625352.384123:0:17257:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625352.384124:0:17257:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625352.384125:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788625352.384128:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625352.384129:0:17257:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788625352.384131:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625352.384136:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625352.384138:0:17257:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788625352.384142:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788625352.384194:0:17257:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788625352.384227:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625352.384231:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625352.384232:0:17257:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788625352.384234:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625352.384237:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625352.384238:0:17257:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788625352.384240:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788625352.384246:0:17257:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:00000080:2.0:1788625352.384272:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788625352.384296:0:17257:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99887b48b380) 00000020:00000080:2.0:1788625352.384313:0:17257:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788625352.384319:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788625352.384373:0:17257:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788625352.384378:0:17257:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788625352.384384:0:17257:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7b44d 00010000:00080000:2.0:1788625352.384424:0:17257:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9988449c8800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.114@tcp at head 00010000:00010000:2.0:1788625352.386763:0:17257:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788625352.390955:0:17257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788625352.390972:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788625352.391014:0:17257:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788625352.391036:0:17257:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7b454 00000100:00080000:3.0:1788625352.391046:0:17257:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788625352.391074:0:17257:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9988449c8800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625352.391110:0:17257:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9987442d7480 x1875509206223232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625352.391139:0:17257:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788625352.391199:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625352.391203:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625352.391205:0:17257:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788625352.391208:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788625352.391211:0:17257:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788625352.391212:0:17257:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788625352.391214:0:17257:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788625352.391216:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788625352.391218:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625352.391219:0:17257:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788625352.391222:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788625352.391227:0:17257:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788625352.391230:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625352.391232:0:17257:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788625352.391234:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788625352.391238:0:17257:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:01000000:3.0:1788625352.391262:0:17257:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788625352.391265:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788625352.391277:0:17257:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff998742ed0000) 00000020:00000080:3.0:1788625352.391299:0:17257:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788625352.391305:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788625352.391375:0:17257:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788625352.391381:0:17257:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788625352.391387:0:17257:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7b462 00010000:00080000:3.0:1788625352.391436:0:17257:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998844cd0800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.114@tcp at head 00000100:00100000:0.0:1788625352.391484:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206223232:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788625352.391596:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625352.391641:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206223232 00000100:00100000:3.0:1788625352.391648:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206223232 00000100:00100000:3.0:1788625352.391682:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625352.391688:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875509206223232:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788625352.391703:0:17244:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:0.0:1788625352.391746:0:17257:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788625352.394945:0:17257:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788625352.395172:0:17257:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788625352.401969:0:17257:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788625352.402634:0:17257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788625352.413054:0:17257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788625352.420656:0:17263:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788625352.420667:0:17263:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1788625352.423838:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875509206223232:12345-0@lo:38:llog_process_th.0 Request processed in 32139us (32233us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788625352.423852:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788625352.424018:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9988449c8800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788625352.424024:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788625352.424029:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206223232:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1788625352.426004:0:17257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788625352.426019:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788625352.426063:0:17257:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788625352.426084:0:17257:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7b469 00000100:00080000:2.0:1788625352.426095:0:17257:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625352.426101:0:17257:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff998844cd0800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625352.426135:0:17257:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874427e300 x1875509206223360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788625352.426191:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206223360:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788625352.426241:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206223360 offset 0 length 520: 4 00000100:00080000:2.0:1788625352.426322:0:17257:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788625352.426385:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625352.426401:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625352.426403:0:17257:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788625352.426407:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788625352.426418:0:17257:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788625352.426421:0:17257:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625352.426423:0:17257:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625352.426425:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788625352.426427:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625352.426429:0:17257:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788625352.426432:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788625352.426436:0:17257:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788625352.426440:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625352.426442:0:17257:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788625352.426445:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788625352.426449:0:17257:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:01000000:2.0:1788625352.426755:0:17257:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788625352.426759:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788625352.426771:0:17257:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99887b488000) 00000020:00000080:2.0:1788625352.426784:0:17257:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788625352.426790:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788625352.426852:0:17257:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788625352.426858:0:17257:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788625352.426863:0:17257:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7b477 00010000:00080000:2.0:1788625352.426893:0:17257:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998874b50000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.114@tcp at head 00010000:00010000:2.0:1788625352.427092:0:17257:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788625352.427163:0:17257:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788625352.427178:0:17257:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788625352.434856:0:17257:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625352.435125:0:17257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788625352.435279:0:17257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788625352.435779:0:17265:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788625352.435784:0:17265:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788625352.436648:0:17257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788625352.436661:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788625352.436718:0:17257:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788625352.436741:0:17257:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7b47e 00000100:00080000:1.0:1788625352.436753:0:17257:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788625352.436759:0:17257:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff998874b50000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625352.436798:0:17257:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998744078e00 x1875509206223488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788625352.436820:0:17257:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788625352.436925:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206223488:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788625352.436985:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206223488 offset 0 length 520: 4 00000020:01000000:1.0:1788625352.437110:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625352.437115:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625352.437117:0:17257:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788625352.437119:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625352.437123:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625352.437124:0:17257:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788625352.437126:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788625352.437128:0:17257:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788625352.437130:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625352.437132:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625352.437133:0:17257:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788625352.437135:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625352.437137:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625352.437138:0:17257:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788625352.437141:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788625352.437169:0:17257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17257:1875509206223616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625352.437219:0:17257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625352.437239:0:17257:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738d4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625352.437615:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206223616 00000100:00100000:1.0:1788625352.437622:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206223616 00000100:00100000:1.0:1788625352.437669:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625352.437677:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+9:17257:x1875509206223616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625352.437794:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+9:17257:x1875509206223616:12345-0@lo:502:llog_process_th.0 Request processed in 117us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625352.437808:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625352.437867:0:17257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17257:1875509206223616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788625352.437894:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625352.437899:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625352.437900:0:17257:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788625352.437904:0:17257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788625352.438204:0:17218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788625352.438226:0:17218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788625352.438250:0:17218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3f9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.438262:0:17218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3f9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625352.438283:0:17218:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998848aae000 from 1 10000000:01000000:2.0:1788625352.438298:0:17218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788625352.438330:0:17218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.438339:0:17218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.438348:0:17218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625352.438364:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206223744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788625352.438412:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625352.438444:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff99874272cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625352.438669:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206223744 00000100:00100000:1.0:1788625352.438674:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206223744 00000100:00100000:1.0:1788625352.438703:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625352.438711:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+9:17218:x1875509206223744:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625352.438721:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625352.438737:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7b48c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b485 expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.438759:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7b48c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b485 expref: 10 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.438771:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7b48c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b485 expref: 10 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.438780:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5800, rc 0) 00000100:00100000:1.0:1788625352.438813:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+10:17218:x1875509206223744:12345-0@lo:101:mount.lustre.0 Request processed in 103us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625352.438819:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625352.438947:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206223744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625352.438961:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b485 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b48c expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.438971:0:17218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b485 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b48c expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625352.439696:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206223872:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788625352.439748:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625352.439837:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff99874272cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625352.439979:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206223872 00000100:00100000:0.0:1788625352.439985:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206223872 00000100:00100000:0.0:1788625352.440054:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625352.440064:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+10:17218:x1875509206223872:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788625352.440080:0:17233:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788625352.440086:0:17233:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788625352.440269:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+10:17218:x1875509206223872:12345-0@lo:256:mount.lustre.0 Request processed in 206us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625352.440276:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788625352.440411:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206223872:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788625352.441147:0:17218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788625352.441229:0:17218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b485 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b48c expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.441240:0:17218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b48c expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625352.441248:0:17218:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998848aae000 from 1 10000000:01000000:2.0:1788625352.441250:0:17218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788625352.441278:0:17218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744188000/0x2d2e3b3f34a7b493 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.441353:0:17218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998744188000/0x2d2e3b3f34a7b493 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.441364:0:17218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998744188000/0x2d2e3b3f34a7b493 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625352.441384:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206224000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788625352.441439:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625352.441614:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff99874272cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625352.441687:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206224000 00000100:00100000:0.0:1788625352.441695:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206224000 00000100:00100000:0.0:1788625352.441738:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625352.441747:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+10:17218:x1875509206224000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625352.441758:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625352.441772:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743ae1e00/0x2d2e3b3f34a7b49a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b493 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625352.441796:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743ae1e00/0x2d2e3b3f34a7b49a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b493 expref: 11 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625352.441808:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743ae1e00/0x2d2e3b3f34a7b49a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b493 expref: 11 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625352.441817:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae1e00, rc 0) 00000100:00100000:0.0:1788625352.441859:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+11:17218:x1875509206224000:12345-0@lo:101:mount.lustre.0 Request processed in 113us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625352.441866:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788625352.441961:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206224000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625352.441976:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998744188000/0x2d2e3b3f34a7b493 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b49a expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.441986:0:17218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998744188000/0x2d2e3b3f34a7b493 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b49a expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625352.442043:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206224128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625352.442071:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625352.442101:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff99874272cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625352.442157:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206224128 00000100:00100000:0.0:1788625352.442162:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206224128 00000100:00100000:0.0:1788625352.442192:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788625352.442199:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+11:17218:x1875509206224128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625352.442330:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+11:17218:x1875509206224128:12345-0@lo:501:mount.lustre.0 Request processed in 132us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625352.442338:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625352.442467:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206224128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625352.442491:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206224256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788625352.442549:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625352.442567:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff99874272cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625352.442679:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206224256 00000100:00100000:0.0:1788625352.442684:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206224256 00000100:00100000:0.0:1788625352.442712:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788625352.442718:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+11:17218:x1875509206224256:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625352.442807:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+11:17218:x1875509206224256:12345-0@lo:503:mount.lustre.0 Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625352.442814:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788625352.442904:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206224256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625352.443225:0:17267:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17267:1875509206224384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625352.443260:0:17267:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625352.443358:0:17267:0:(client.c:2716:ptlrpc_set_wait()) set ffff998845258240 going to sleep for 11 seconds 00000100:00100000:2.0:1788625352.443412:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206224384 00000100:00100000:2.0:1788625352.443416:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206224384 00000100:00100000:2.0:1788625352.443441:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788625352.443448:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+11:17267:x1875509206224384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625352.443986:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+11:17267:x1875509206224384:12345-0@lo:502:llog_process_th.0 Request processed in 536us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625352.443994:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625352.444079:0:17267:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17267:1875509206224384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788625352.444104:0:17267:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625352.444115:0:17267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625352.444118:0:17267:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788625352.444126:0:17267:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998848aae000 00000020:00000080:0.0:1788625352.444129:0:17267:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788625352.444137:0:17267:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625352.444146:0:17267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625352.444147:0:17267:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788625352.444151:0:17267:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625352.444154:0:17267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625352.444155:0:17267:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788625352.444159:0:17267:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998848aae000 00000020:00000080:0.0:1788625352.444161:0:17267:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788625352.444222:0:17267:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625352.444226:0:17267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625352.444227:0:17267:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788625352.444230:0:17267:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625352.444231:0:17267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625352.444233:0:17267:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788625352.444236:0:17267:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998848aae000 00000020:00000080:0.0:1788625352.444238:0:17267:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788625352.444256:0:17267:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625352.444258:0:17267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625352.444260:0:17267:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788625352.444262:0:17267:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625352.444264:0:17267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625352.444266:0:17267:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788625352.444270:0:17267:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998848aae000 00000020:00000080:0.0:1788625352.444272:0:17267:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788625352.444368:0:17267:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17267:1875509206224512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625352.444420:0:17267:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625352.444442:0:17267:0:(client.c:2716:ptlrpc_set_wait()) set ffff998845258240 going to sleep for 11 seconds 00000100:00100000:1.0:1788625352.445592:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206224512 00000100:00100000:1.0:1788625352.445601:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206224512 00000100:00100000:1.0:1788625352.445640:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788625352.445649:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+11:17267:x1875509206224512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625352.445776:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+11:17267:x1875509206224512:12345-0@lo:502:llog_process_th.0 Request processed in 127us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625352.445783:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788625352.445884:0:17267:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17267:1875509206224512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788625352.445912:0:17267:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625352.445919:0:17267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625352.445921:0:17267:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788625352.445926:0:17267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788625352.446096:0:17218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788625352.446116:0:17218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788625352.446136:0:17218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744188000/0x2d2e3b3f34a7b493 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b49a expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625352.446147:0:17218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998744188000/0x2d2e3b3f34a7b493 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b49a expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625352.446200:0:17218:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788625352.446203:0:17218:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998848aae000 10000000:01000000:3.0:1788625352.446206:0:17218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998848aae000 10000000:01000000:3.0:1788625352.446210:0:17218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788625352.446216:0:17218:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998848aae000 from 1 10000000:01000000:3.0:1788625352.446219:0:17218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788625352.446251:0:17218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625352.446260:0:17218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625352.446270:0:17218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625352.446382:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206224640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625352.446437:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625352.446669:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743a906c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625352.447436:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206224640 00000100:00100000:1.0:1788625352.447444:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206224640 00000100:00100000:1.0:1788625352.447487:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788625352.447496:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+11:17218:x1875509206224640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625352.447508:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625352.447553:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e4e00/0x2d2e3b3f34a7b4a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b4a1 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.447580:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e4e00/0x2d2e3b3f34a7b4a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b4a1 expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.447592:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e4e00/0x2d2e3b3f34a7b4a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b4a1 expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625352.447601:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4e00, rc 0) 00000100:00100000:1.0:1788625352.447644:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17218:x1875509206224640:12345-0@lo:101:mount.lustre.0 Request processed in 150us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625352.447650:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788625352.447838:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206224640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625352.447853:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b4a8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625352.447863:0:17218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b4a8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625352.447921:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206224768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625352.447952:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625352.448040:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743a906c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625352.448089:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206224768 00000100:00100000:1.0:1788625352.448094:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206224768 00000100:00100000:1.0:1788625352.448126:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788625352.448133:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17218:x1875509206224768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788625352.448264:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17218:x1875509206224768:12345-0@lo:501:mount.lustre.0 Request processed in 131us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625352.448284:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788625352.448633:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206224768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625352.448664:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206224896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625352.448708:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625352.448774:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743a906c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625352.453839:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206224896 00000100:00100000:0.0:1788625352.453859:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206224896 00000100:00100000:3.0:1788625352.462655:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788625352.462670:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17218:x1875509206224896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625352.462843:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17218:x1875509206224896:12345-0@lo:503:mount.lustre.0 Request processed in 175us (14133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625352.462851:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788625352.462924:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206224896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625352.473686:0:17272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17272:1875509206225024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625352.473764:0:17272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625352.473855:0:17272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988512d30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625352.473903:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206225024 00000100:00100000:0.0:1788625352.473910:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206225024 00000100:00100000:0.0:1788625352.473984:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788625352.473992:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17272:x1875509206225024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625352.474209:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17272:x1875509206225024:12345-0@lo:502:llog_process_th.0 Request processed in 216us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625352.474217:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625352.474316:0:17272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17272:1875509206225024:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788625352.474384:0:17272:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788625352.474418:0:17272:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99887da599c0) 00000020:00000080:1.0:1788625352.474437:0:17272:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788625352.474546:0:17272:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998848aae000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788625352.474551:0:17272:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998848aae000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788625352.474554:0:17272:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998848aae000 4 00010000:00080000:1.0:1788625352.474582:0:17272:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99887ca79000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.114@tcp at head 00010000:00010000:1.0:1788625352.479633:0:17272:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788625352.479858:0:17272:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788625352.479912:0:17272:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788625352.479931:0:17272:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2d2e3b3f34a7b4b6 00000100:00080000:1.0:1788625352.479945:0:17272:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788625352.479952:0:17272:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99887ca79000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625352.479991:0:17272:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874407b800 x1875509206225152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788625352.480036:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206225152:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788625352.482042:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788625352.482181:0:17272:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788625352.482905:0:17272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17272:1875509206225280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625352.482972:0:17272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625352.483005:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206225280 00000100:00100000:3.0:1788625352.483011:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206225280 00000100:00100000:2.0:1788625352.483168:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206225152 00000100:00100000:2.0:1788625352.483173:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206225152 00000100:00100000:2.0:1788625352.483196:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625352.483204:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875509206225152:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788625352.483260:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875509206225152:12345-0@lo:38:llog_process_th.0 Request processed in 56us (1223us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788625352.483268:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788625352.483406:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788625352.483415:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887ca79000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788625352.483419:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788625352.483423:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206225152:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788625352.483636:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788625352.483646:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17272:x1875509206225280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625352.483755:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17272:x1875509206225280:12345-0@lo:502:llog_process_th.0 Request processed in 111us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625352.483761:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788625352.483815:0:17272:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988512d30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625352.483829:0:17272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17272:1875509206225280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625352.483868:0:17272:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17272:1875509206225408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625352.483899:0:17272:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625352.484007:0:17272:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743a90240 going to sleep for 11 seconds 00000100:00100000:0.0:1788625352.484348:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206225408 00000100:00100000:0.0:1788625352.484354:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206225408 00000100:00100000:0.0:1788625352.484403:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788625352.484411:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17272:x1875509206225408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625352.484493:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17272:x1875509206225408:12345-0@lo:502:llog_process_th.0 Request processed in 84us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625352.484500:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788625352.484658:0:17272:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17272:1875509206225408:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788625352.484679:0:17272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788625352.484815:0:17218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788625352.484837:0:17218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788625352.484891:0:17218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b4a8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625352.484902:0:17218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b4a8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788625352.484944:0:17218:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788625352.484946:0:17218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625352.484947:0:17218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625352.484949:0:17218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625352.484950:0:17218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625352.484951:0:17218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625352.484952:0:17218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625352.484957:0:17218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625352.484959:0:17218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625352.484960:0:17218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788625352.484963:0:17218:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788625352.484965:0:17218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788625352.484966:0:17218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625352.484967:0:17218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625352.484968:0:17218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625352.484969:0:17218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625352.484970:0:17218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625352.484971:0:17218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625352.484971:0:17218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625352.484972:0:17218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625352.484973:0:17218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788625352.484987:0:17218:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788625352.484998:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206225536:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788625352.485031:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625352.485065:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff99874272cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625352.485185:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206225536 00000100:00100000:2.0:1788625352.485189:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206225536 00000100:00100000:2.0:1788625352.485224:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788625352.485231:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17218:x1875509206225536:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788625352.485250:0:17234:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788625352.485262:0:17234:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788625352.487143:0:17234:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788625352.487167:0:17234:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788625352.487378:0:17255:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788625352.487384:0:17255:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788625352.487416:0:17255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b4bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625352.487435:0:17255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7b48c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b485 expref: 12 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625352.487444:0:17255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b4bd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625352.487494:0:17255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7b48c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7b485 expref: 12 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625352.487510:0:17255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7b48c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b485 expref: 12 pid: 17232 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625352.487554:0:17255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17255:1875509206225664:0@lo:104: 00000100:00100000:0.0:1788625352.487612:0:17255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625352.487651:0:17255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da180 going to sleep for 11 seconds 00000100:00100000:0.0:1788625352.487689:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206225664 00000100:00100000:0.0:1788625352.487695:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206225664 00000100:00100000:0.0:1788625352.487735:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625352.487743:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744829880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+3:17255:x1875509206225664:12345-0@lo:104: 00010000:00010000:0.0:1788625352.487758:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b48c expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625352.487803:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788625352.487808:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744829880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+3:17255:x1875509206225664:12345-0@lo:104: Request processed in 66us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625352.487815:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625352.487848:0:17255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17255:1875509206225664:0@lo:104: 00010000:00010000:0.0:1788625352.487866:0:17255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b4bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.487994:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625352.488001:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b48c expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488008:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189600 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625352.488013:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7b48c expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488021:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7b48c expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625352.488028:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7b48c expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625352.488034:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788625352.488236:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b48c expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488243:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788625352.488299:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206225792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625352.488327:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625352.488368:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b485 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b48c expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488376:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b48c expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488402:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625352.488404:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625352.488405:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625352.488536:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206225792 00000100:00100000:2.0:1788625352.488541:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206225792 00010000:00010000:2.0:1788625352.488567:0:17224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7b48c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b485 expref: 13 pid: 17232 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625352.488589:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625352.488595:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744828380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+13:3637:x1875509206225792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625352.488605:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625352.488609:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7b48c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b485 expref: 13 pid: 17232 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488618:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7b48c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b485 expref: 13 pid: 17232 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488629:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7b48c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b485 expref: 13 pid: 17232 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488641:0:17224:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b4bd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488647:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b4bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788625352.488659:0:17224:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001275927s 00010000:00010000:2.0:1788625352.488663:0:17224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b4bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488668:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b4bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488675:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b4bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488680:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b4bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488689:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625352.488693:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b4bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488700:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b4bd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488711:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b4bd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488723:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625352.488878:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744828380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:3637:x1875509206225792:12345-0@lo:103:ldlm_bl.0 Request processed in 282us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625352.488883:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788625352.488939:0:17255:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b4bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488947:0:17255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b4bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625352.488954:0:17255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b4bd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625352.489146:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17218:1875509206225536:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788625352.489159:0:17218:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788625352.489162:0:17218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788625352.489164:0:17218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788625352.489165:0:17218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625352.489166:0:17218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625352.489167:0:17218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625352.489168:0:17218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625352.489170:0:17218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788625352.489171:0:17218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788625352.489173:0:17218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625352.489180:0:17218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788625352.489192:0:17218:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788625352.490136:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206225792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625352.492145:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+11:17218:x1875509206225536:12345-0@lo:253:mount.lustre.0 Request processed in 3817us (4015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625352.492164:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000020:00080000:3.0:1788625352.502305:0:17218:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788625352.503189:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788625352.503601:0:17279:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788625352.503852:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1788625352.504341:0:17279:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625352.507385:0:17279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788625352.507483:0:17279:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:2.0:1788625352.508974:0:17280:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff99874427ea00 x1875509206225920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625352.509008:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 00000040:01000000:0.0:1788625352.509545:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788625352.509592:0:17218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788625352.510009:0:17218:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788625352.510017:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788625352.510051:0:17218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788625352.511851:0:17278:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000040:00080000:0.0:1788625352.511855:0:17218:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:1.0:1788625352.511985:0:17278:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1788625352.512655:0:17218:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788625352.512706:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788625352.514968:0:17218:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788625352.519777:0:17218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788625352.522163:0:17218:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788625352.522285:0:17218:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa6ab01c87988 00100000:10000000:0.0:1788625352.522294:0:17218:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788625352.526567:0:17218:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788625352.526586:0:17218:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788625352.526615:0:17218:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788625352.526632:0:17218:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788625352.528923:0:17218:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788625352.529138:0:17218:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788625353.099878:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788625353.484734:0:17273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788625353.548578:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 10000000:01000000:0.0:1788625353.612320:0:17236:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788625353.612330:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998848aae000 from 7 10000000:01000000:0.0:1788625353.612336:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788625353.612402:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b4c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625353.612417:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b4c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625353.612430:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b4c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625353.612458:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206226048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625353.612916:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625353.612972:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fea000 going to sleep for 11 seconds 00000100:00100000:1.0:1788625353.613083:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206226048 00000100:00100000:1.0:1788625353.613092:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206226048 00000100:00100000:1.0:1788625353.613150:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788625353.613159:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+11:17236:x1875509206226048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625353.613177:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625353.613192:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e5c00/0x2d2e3b3f34a7b4cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b4c4 expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625353.613221:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e5c00/0x2d2e3b3f34a7b4cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b4c4 expref: 12 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625353.613233:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e5c00/0x2d2e3b3f34a7b4cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b4c4 expref: 12 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625353.613243:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5c00, rc 0) 00000100:00100000:1.0:1788625353.613300:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17236:x1875509206226048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625353.613308:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788625353.613418:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206226048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625353.613436:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b4c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b4cb expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625353.613446:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b4c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b4cb expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625353.613501:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206226176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788625353.613569:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625353.613593:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788625353.613678:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206226176 00000100:00100000:0.0:1788625353.613684:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206226176 00000100:00100000:0.0:1788625353.614250:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788625353.614260:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17236:x1875509206226176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788625353.614286:0:17234:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788625353.614302:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788625353.614306:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788625353.614423:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17236:x1875509206226176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 165us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625353.614431:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625353.617095:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206226176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788625353.617176:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788625353.617190:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b4c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b4cb expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625353.617202:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b4c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b4cb expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625354.127753:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625354.512268:0:17273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788625354.572676:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 00010000:00010000:2.0:1788625355.151161:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625355.595596:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 00000001:02000400:3.0:1788625356.009125:0:17522:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788625356.179905:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625356.621781:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 00000020:00000004:3.0:1788625356.907790:0:17574:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625356.907983:0:17574:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788625357.195727:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625357.581109:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3638:1875509206226304:0@lo:400:kworker.0 00000100:00100000:3.0:1788625357.581197:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625357.581280:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206226304 00000100:00100000:3.0:1788625357.581297:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206226304 00000100:00100000:3.0:1788625357.581361:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788625357.581372:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:3638:x1875509206226304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625357.581450:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:3638:x1875509206226304:12345-0@lo:400:kworker.0 Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625357.581458:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788625357.581512:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3638:1875509206226304:0@lo:400:kworker.0 00000100:00080000:2.0:1788625357.584734:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788625357.584743:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788625357.584757:0:38:0:(import.c:65:import_set_state_nolock()) ffff9988449c8800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788625357.584764:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:2.0:1788625357.584770:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788625357.584777:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9988449c8800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625357.587149:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874427dc00 x1875509206226432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788625357.587181:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625357.587186:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625357.587189:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625357.587193:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625357.587196:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788625357.587200:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788625357.587203:0:38:0:(import.c:65:import_set_state_nolock()) ffff99887ca79000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788625357.587211:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99887ca79000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625357.587224:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874427c000 x1875509206226560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788625357.589825:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206226432:0@lo:38:kworker.0 00000100:00100000:1.0:1788625357.589996:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625357.591130:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206226560:0@lo:38:kworker.0 00000100:00100000:1.0:1788625357.591185:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625357.591256:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206226432 00000100:00100000:1.0:1788625357.591267:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206226432 00000100:00100000:3.0:1788625357.591389:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206226560 00000100:00100000:3.0:1788625357.591396:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206226560 00000100:00100000:3.0:1788625357.592620:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625357.592631:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875509206226560:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788625357.592671:0:17241:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:3.0:1788625357.592718:0:17241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2d2e3b3f34a7b4d2 00000004:00100000:3.0:1788625357.592736:0:17241:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788625357.593027:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788625357.593033:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875509206226432:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788625357.593116:0:17245:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788625357.595006:0:17241:0:(import.c:65:import_set_state_nolock()) ffff998848849000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625357.595653:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875509206226560:12345-0@lo:38:kworker.0 Request processed in 3018us (4464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625357.595670:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788625357.606669:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99874427c000 x1875509206226560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788625357.606698:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788625357.606710:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788625357.606717:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788625357.606722:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887ca79000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788625357.606730:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206226560:0@lo:38:kworker.0 00000100:00100000:1.0:1788625357.625442:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875509206226432:12345-0@lo:38:kworker.0 Request processed in 32397us (35436us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788625357.625459:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788625357.625482:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9988449c8800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625357.625492:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788625357.625496:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206226432:0@lo:38:kworker.0 00000100:00100000:0.0:1788625357.652485:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 00000020:00000004:3.0:1788625357.734093:0:17625:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625357.734403:0:17625:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788625358.220081:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625358.667642:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788625359.243833:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625359.691596:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788625360.268289:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625360.716068:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788625361.297441:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625361.739991:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788625362.316771:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788625362.702240:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788625362.702311:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788625362.702316:0:38:0:(import.c:65:import_set_state_nolock()) ffff9988449c8800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625362.702325:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 478 00000100:00080000:1.0:1788625362.702332:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788625362.702341:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9988449c8800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625362.702366:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998744078380 x1875509206226816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625362.704165:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625352/real 1788625352] req@ffff998744078e00 x1875509206223488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625362 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625362.707145:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998744078e00 x1875509206223488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625362 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625362.707175:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625352/real 1788625352] req@ffff99874427e300 x1875509206223360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625362 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625362.707205:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99874427e300 x1875509206223360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625362 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625362.707231:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206226816:0@lo:38:kworker.0 00000100:00100000:3.0:1788625362.710450:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788625362.710560:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998874b50000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788625362.710633:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206226816 00000100:00100000:0.0:1788625362.710643:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206226816 00000100:00100000:0.0:1788625362.710687:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625362.710695:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875509206226816:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788625362.710732:0:17244:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788625362.716109:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625362.716121:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788625362.716124:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625362.716128:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788625362.716132:0:38:0:(import.c:65:import_set_state_nolock()) ffff998874b50000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625362.716141:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:1.0:1788625362.716148:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788625362.716239:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff998874b50000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625362.716386:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206226688:0@lo:400:kworker.0 00000100:00100000:1.0:1788625362.716460:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625362.717745:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998744078000 x1875509206226944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788625362.717808:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625362.717819:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206227072:0@lo:400:kworker.0 00000100:00100000:1.0:1788625362.717868:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625362.717934:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206227072 00000100:00100000:1.0:1788625362.717943:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206227072 00000100:00100000:1.0:1788625362.717988:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788625362.717997:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206227072:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788625362.718281:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788625362.718293:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206223488:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788625362.718331:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998844cd0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625362.718343:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788625362.718347:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206223360:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788625362.718379:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206226944:0@lo:8:kworker.0 00000400:00000100:3.0:1788625362.718408:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206226944 offset 0 length 520: 4 00000100:00100000:3.0:1788625362.718590:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206226688 00000100:00100000:3.0:1788625362.718595:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206226688 00000100:00100000:3.0:1788625362.718624:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788625362.718630:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:3635:x1875509206226688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625362.718678:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:3635:x1875509206226688:12345-0@lo:400:kworker.0 Request processed in 47us (2218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625362.718685:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788625362.720535:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206227072:12345-0@lo:400:kworker.0 Request processed in 2517us (2644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625362.721087:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788625362.721649:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99874407bb80 x1875509206227072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625362.721665:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206227072:0@lo:400:kworker.0 00000100:00100000:1.0:1788625362.721684:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206226688:0@lo:400:kworker.0 00000100:00080000:1.0:1788625362.721721:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625362.721726:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788625362.721729:0:38:0:(import.c:65:import_set_state_nolock()) ffff998844cd0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625362.721734:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:1.0:1788625362.721738:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788625362.721743:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff998844cd0800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625362.721773:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874407a680 x1875509206227200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625362.722345:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206227200:0@lo:8:kworker.0 00000400:00000100:3.0:1788625362.722396:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206227200 offset 0 length 520: 4 00000100:00100000:0.0:1788625362.745208:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875509206226816:12345-0@lo:38:kworker.0 Request processed in 34503us (34756us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788625362.745223:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788625362.745275:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9988449c8800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625362.745284:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625362.745288:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206226816:0@lo:38:kworker.0 00000100:00100000:2.0:1788625362.765147:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 00010000:00010000:2.0:1788625363.341030:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625363.790104:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 00000020:01000004:3.0:1788625363.941091:0:17969:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788625363.941095:0:17969:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788625363.941097:0:17969:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788625363.941279:0:17969:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9987427c7800 00000020:01000004:3.0:1788625363.941298:0:17969:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788625363.941310:0:17969:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788625363.941324:0:17969:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff998742ed19c0) 00000020:00000080:3.0:1788625363.941344:0:17969:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788625364.038480:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788625364.039726:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788625364.042686:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788625364.043432:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788625364.047584:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788625364.048249:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788625364.049243:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788625364.050271:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788625364.050715:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788625364.051051:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788625364.052903:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788625364.054814:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788625364.057571:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788625364.058028:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788625364.059357:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788625364.059850:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788625364.060404:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788625364.060641:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788625364.067852:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788625364.068996:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788625364.069722:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788625364.070700:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788625364.071136:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788625364.071669:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788625364.071892:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788625364.072378:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788625364.073566:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788625364.076268:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788625364.081296:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788625364.081861:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788625364.082299:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788625364.082637:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788625364.082894:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788625364.083197:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788625364.087495:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788625364.089061:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788625364.089875:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788625364.090627:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788625364.092496:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788625364.094442:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788625364.097135:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788625364.103119:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788625364.103978:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788625364.104470:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788625364.111933:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788625364.114420:0:17969:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:0.0:1788625364.124708:0:17969:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788625364.125004:0:17969:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788625364.125019:0:17969:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788625364.125033:0:17969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a7b4e0 00000020:01000004:0.0:1788625364.125041:0:17969:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788625364.125064:0:17969:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.114@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788625364.125068:0:17969:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788625364.125073:0:17969:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788625364.125100:0:17969:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788625364.125104:0:17969:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.114@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788625364.142799:0:17969:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.114@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788625364.142850:0:17969:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.114@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788625364.142855:0:17969:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788625364.142857:0:17969:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788625364.142858:0:17969:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625364.142859:0:17969:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625364.142860:0:17969:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625364.142862:0:17969:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625364.142868:0:17969:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788625364.142870:0:17969:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625364.142872:0:17969:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788625364.142876:0:17969:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788625364.142878:0:17969:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788625364.142879:0:17969:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788625364.142881:0:17969:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625364.142881:0:17969:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625364.142882:0:17969:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625364.142883:0:17969:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625364.142884:0:17969:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788625364.142885:0:17969:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625364.142886:0:17969:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788625364.142914:0:17969:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788625364.142934:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206227328:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788625364.143012:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625364.143126:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788625364.144802:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206227328 00000100:00100000:1.0:1788625364.144816:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206227328 00000100:00100000:1.0:1788625364.144896:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788625364.144907:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17969:x1875509206227328:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788625364.144945:0:17233:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788625364.144948:0:17233:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788625364.144957:0:17233:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788625364.145748:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17969:x1875509206227328:12345-0@lo:253:mount.lustre.0 Request processed in 839us (2731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625364.145758:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788625364.145886:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206227328:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788625364.145899:0:17969:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788625364.145903:0:17969:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788625364.145905:0:17969:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788625364.145906:0:17969:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625364.145907:0:17969:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625364.145908:0:17969:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625364.145910:0:17969:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625364.145911:0:17969:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788625364.145912:0:17969:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625364.145914:0:17969:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788625364.145990:0:17969:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9987427c7800 from lustre-MDT0001 10000000:01000000:1.0:1788625364.146019:0:17969:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788625364.146022:0:17969:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788625364.146029:0:17969:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99887cb18000 local copy 00010000:00010000:1.0:1788625364.146039:0:17969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625364.146344:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206227456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788625364.146381:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625364.146419:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff998858074f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788625364.146488:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206227456 00000100:00100000:3.0:1788625364.146494:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206227456 00000100:00100000:3.0:1788625364.146568:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788625364.146577:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17969:x1875509206227456:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625364.146655:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17969:x1875509206227456:12345-0@lo:501:mount.lustre.0 Request processed in 79us (273us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788625364.146662:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788625364.146825:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206227456:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788625364.146839:0:17969:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788625364.146864:0:17969:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788625364.146870:0:17969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.146891:0:17969:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625364.146919:0:17969:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9987427c7800 10000000:01000000:2.0:1788625364.146924:0:17969:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788625364.146929:0:17969:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99887cb18000 10000000:01000000:2.0:1788625364.146932:0:17969:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788625364.146936:0:17969:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99887cb18000 from 1 10000000:01000000:2.0:1788625364.146939:0:17969:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788625364.146964:0:17969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744188e00/0x2d2e3b3f34a7b4e7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.146973:0:17969:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998744188e00/0x2d2e3b3f34a7b4e7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.146983:0:17969:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998744188e00/0x2d2e3b3f34a7b4e7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625364.147010:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206227584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788625364.147040:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625364.147065:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788625364.147117:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206227584 00000100:00100000:1.0:1788625364.147122:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206227584 00000100:00100000:1.0:1788625364.147168:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788625364.147176:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+12:17969:x1875509206227584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625364.147185:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625364.147199:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e5200/0x2d2e3b3f34a7b4ee lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b4e7 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625364.147234:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e5200/0x2d2e3b3f34a7b4ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b4e7 expref: 13 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625364.147258:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e5200/0x2d2e3b3f34a7b4ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b4e7 expref: 13 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625364.147270:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5200, rc 0) 00000100:00100000:1.0:1788625364.147307:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+13:17969:x1875509206227584:12345-0@lo:101:mount.lustre.0 Request processed in 132us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625364.147313:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788625364.147572:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206227584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625364.147585:0:17969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998744188e00/0x2d2e3b3f34a7b4e7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b4ee expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.147595:0:17969:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998744188e00/0x2d2e3b3f34a7b4e7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b4ee expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625364.147624:0:17969:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788625364.147641:0:17969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744188e00/0x2d2e3b3f34a7b4e7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b4ee expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.147649:0:17969:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998744188e00/0x2d2e3b3f34a7b4e7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b4ee expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625364.147657:0:17969:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9987427c7800 10000000:01000000:2.0:1788625364.147660:0:17969:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788625364.147664:0:17969:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9987427c7800 from 1 10000000:01000000:2.0:1788625364.147666:0:17969:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788625364.147683:0:17969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.147690:0:17969:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.147699:0:17969:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625364.147712:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206227712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788625364.147740:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625364.147757:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788625364.147845:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206227712 00000100:00100000:0.0:1788625364.147850:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206227712 00000100:00100000:0.0:1788625364.148013:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788625364.148021:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+13:17969:x1875509206227712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625364.148029:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625364.148038:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743ae1600/0x2d2e3b3f34a7b4fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b4f5 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.148053:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743ae1600/0x2d2e3b3f34a7b4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b4f5 expref: 14 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.148061:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743ae1600/0x2d2e3b3f34a7b4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b4f5 expref: 14 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.148076:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae1600, rc 0) 00000100:00100000:0.0:1788625364.148119:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+14:17969:x1875509206227712:12345-0@lo:101:mount.lustre.0 Request processed in 99us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625364.148125:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788625364.148474:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206227712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625364.148487:0:17969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b4fc expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.148497:0:17969:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b4fc expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625364.148540:0:17969:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788625364.148546:0:17969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b4fc expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.148554:0:17969:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b4fc expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625364.148561:0:17969:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788625364.148565:0:17969:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788625364.148570:0:17969:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9987427c7800 10000000:01000000:2.0:1788625364.148573:0:17969:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788625364.148576:0:17969:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788625364.148578:0:17969:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788625364.148595:0:17969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.148603:0:17969:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.148611:0:17969:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625364.148625:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206227840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788625364.148655:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625364.148679:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788625364.148742:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206227840 00000100:00100000:0.0:1788625364.148747:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206227840 00000100:00100000:0.0:1788625364.148769:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788625364.148775:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+14:17969:x1875509206227840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625364.148782:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625364.148793:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743ae1200/0x2d2e3b3f34a7b50a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b503 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.148805:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743ae1200/0x2d2e3b3f34a7b50a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b503 expref: 15 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.148812:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743ae1200/0x2d2e3b3f34a7b50a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b503 expref: 15 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.148818:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae1200, rc 0) 00000100:00100000:0.0:1788625364.148854:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+15:17969:x1875509206227840:12345-0@lo:101:mount.lustre.0 Request processed in 80us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625364.148860:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788625364.148999:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206227840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625364.149008:0:17969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b50a expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.149023:0:17969:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b50a expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625364.160149:0:17969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788625364.162771:0:17969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625364.173652:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788625364.173724:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788625364.173742:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788625364.173756:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788625364.173771:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1788625364.173784:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1788625364.173797:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1788625364.173810:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788625364.173830:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788625364.173844:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1788625364.173857:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1788625364.173869:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1788625364.173881:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1788625364.173894:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788625364.173905:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788625364.173920:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1788625364.173934:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788625364.173947:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788625364.173959:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1788625364.173970:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788625364.173982:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788625364.173994:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788625364.174007:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788625364.174034:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1788625364.174040:0:17969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788625364.174177:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206227968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625364.174247:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625364.174300:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988488f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625364.174562:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206227968 00000100:00100000:2.0:1788625364.174573:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206227968 00000100:00100000:2.0:1788625364.174627:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625364.174637:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+15:17969:x1875509206227968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625364.174797:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+15:17969:x1875509206227968:12345-0@lo:501:mount.lustre.0 Request processed in 160us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625364.174806:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788625364.175422:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206227968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625364.175470:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206228096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625364.175556:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625364.175588:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988488f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625364.175749:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206228096 00000100:00100000:0.0:1788625364.175755:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206228096 00000100:00100000:0.0:1788625364.175795:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788625364.175803:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+15:17969:x1875509206228096:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625364.176591:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+15:17969:x1875509206228096:12345-0@lo:503:mount.lustre.0 Request processed in 786us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625364.176605:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788625364.176902:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206228096:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788625364.177494:0:17969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788625364.177674:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206228224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625364.177731:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625364.177768:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988488f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625364.177868:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206228224 00000100:00100000:0.0:1788625364.177875:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206228224 00000100:00100000:0.0:1788625364.177917:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788625364.177926:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+15:17969:x1875509206228224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625364.179101:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+15:17969:x1875509206228224:12345-0@lo:502:mount.lustre.0 Request processed in 1171us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625364.179112:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788625364.179297:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206228224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788625364.179573:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788625364.179614:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1788625364.179630:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1788625364.179642:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1788625364.179654:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1788625364.179665:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1788625364.179676:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1788625364.179689:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1788625364.179704:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1788625364.179721:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1788625364.179736:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1788625364.179749:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1788625364.179763:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1788625364.179776:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1788625364.179790:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1788625364.179803:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1788625364.179817:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1788625364.179842:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1788625364.179857:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1788625364.179870:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1788625364.179882:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1788625364.179896:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1788625364.179910:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1788625364.179923:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1788625364.179936:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1788625364.179950:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1788625364.179964:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1788625364.179979:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1788625364.179993:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1788625364.180007:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1788625364.180021:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1788625364.180034:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1788625364.180048:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1788625364.180062:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1788625364.180076:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1788625364.180330:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1788625364.180346:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1788625364.180360:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1788625364.180373:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1788625364.180390:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1788625364.180404:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1788625364.180417:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1788625364.180432:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1788625364.180447:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1788625364.180488:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206228352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625364.180583:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625364.180782:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788625364.181565:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206228352 00000100:00100000:3.0:1788625364.181575:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206228352 00000100:00100000:3.0:1788625364.181777:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788625364.181789:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+15:17969:x1875509206228352:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625364.181958:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+15:17969:x1875509206228352:12345-0@lo:502:mount.lustre.0 Request processed in 172us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625364.181966:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788625364.182062:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206228352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788625364.182145:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1788625364.182167:0:17969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788625364.184172:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625364.184192:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.184195:0:17973:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788625364.184202:0:17973:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788625364.184205:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788625364.184230:0:17973:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff99887394cd40) 00000020:00000080:2.0:1788625364.184261:0:17973:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788625364.184269:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788625364.184356:0:17973:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788625364.184364:0:17973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a7b518 00000020:00000080:2.0:1788625364.184636:0:17973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788625364.184640:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625364.184644:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.184646:0:17973:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788625364.184648:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625364.184652:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.184653:0:17973:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788625364.184657:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788625364.184664:0:17973:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff998873948000) 00000020:00000080:2.0:1788625364.184676:0:17973:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788625364.184679:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788625364.184681:0:17973:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788625364.184684:0:17973:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788625364.184691:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788625364.184738:0:17973:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9987427c7800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788625364.184749:0:17973:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9988739499c0) 00000020:00000080:2.0:1788625364.184757:0:17973:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788625364.187482:0:17973:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788625364.187501:0:17973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7b52d 00000020:00000080:2.0:1788625364.187716:0:17973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788625364.187737:0:17973:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788625364.187743:0:17973:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2d2e3b3f34a7b534 00080000:01000000:2.0:1788625364.187751:0:17973:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788625364.187756:0:17973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a7b53b 00010000:00010000:3.0:1788625364.319741:0:17973:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788625364.320558:0:17973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788625364.321818:0:17973:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788625364.327380:0:17973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788625364.327395:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625364.327407:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625364.327409:0:17973:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788625364.327414:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625364.327421:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625364.327423:0:17973:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788625364.327426:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788625364.327432:0:17973:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:00000080:3.0:1788625364.327462:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788625364.327478:0:17973:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff998742ed3380) 00000020:00000080:3.0:1788625364.327605:0:17973:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788625364.327692:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788625364.327786:0:17973:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788625364.327806:0:17973:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788625364.327814:0:17973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a7b549 00010000:00080000:3.0:1788625364.327849:0:17973:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99887ca92800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.114@tcp at head 00010000:00010000:3.0:1788625364.332328:0:17973:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788625364.337707:0:17973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788625364.337724:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788625364.337777:0:17973:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788625364.337806:0:17973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7b550 00000100:00080000:0.0:1788625364.337818:0:17973:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788625364.337826:0:17973:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99887ca92800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625364.337917:0:17973:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874482b100 x1875509206228480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625364.337994:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206228480:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788625364.338088:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788625364.338224:0:17973:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788625364.338259:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788625364.338264:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788625364.338267:0:38:0:(import.c:65:import_set_state_nolock()) ffff9988449c8800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788625364.338273:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:2.0:1788625364.338277:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788625364.338281:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9988449c8800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625364.338298:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874427ce00 x1875509206228608/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788625364.338837:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206228480 00000100:00100000:1.0:1788625364.338848:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206228480 00000100:00100000:0.0:1788625364.338863:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206228608:0@lo:38:kworker.0 00000100:00100000:1.0:1788625364.338889:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625364.338898:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875509206228480:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788625364.338909:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788625364.338926:0:17245:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:1.0:1788625364.338964:0:17245:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7b557 00000100:00100000:0.0:1788625364.338970:0:17244:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788625364.338982:0:17244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00100000:1.0:1788625364.338983:0:17245:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788625364.338992:0:17245:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788625364.339192:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206228608 00000100:00100000:0.0:1788625364.339197:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206228608 00000100:00100000:0.0:1788625364.339296:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625364.339303:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1875509206228608:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1788625364.339565:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625364.339571:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625364.339574:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625364.339577:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788625364.339634:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625364.339962:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1875509206228608:12345-0@lo:38:kworker.0 Request processed in 656us (1052us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788625364.339984:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788625364.340082:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206228736:0@lo:400:kworker.0 00000100:00100000:2.0:1788625364.340123:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625364.340182:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788625364.340190:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9988449c8800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788625364.340200:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788625364.340204:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206228608:0@lo:38:kworker.0 00000100:00100000:2.0:1788625364.340230:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206228736 00000100:00100000:2.0:1788625364.340234:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206228736 00000100:00100000:2.0:1788625364.340270:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625364.340278:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206228736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625364.340322:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206228736:12345-0@lo:400:kworker.0 Request processed in 46us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625364.340329:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788625364.340443:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99874427f480 x1875509206228736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625364.340454:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206228736:0@lo:400:kworker.0 00000020:01000000:2.0:1788625364.340970:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625364.340978:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.340980:0:17973:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788625364.340983:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788625364.340986:0:17973:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788625364.340988:0:17973:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625364.340989:0:17973:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625364.340991:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788625364.340993:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.340995:0:17973:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788625364.340997:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625364.341003:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.341005:0:17973:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788625364.341011:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788625364.341197:0:17973:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788625364.341217:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625364.341220:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.341229:0:17973:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788625364.341233:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788625364.341235:0:17973:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788625364.341236:0:17973:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625364.341237:0:17973:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625364.341238:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788625364.341240:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.341242:0:17973:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788625364.341244:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788625364.341247:0:17973:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788625364.341250:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.341251:0:17973:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788625364.341254:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788625364.341258:0:17973:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:01000000:2.0:1788625364.341280:0:17973:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788625364.341283:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788625364.341296:0:17973:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff99887394b380) 00000020:00000080:2.0:1788625364.341445:0:17973:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788625364.341454:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:1.0:1788625364.344746:0:17245:0:(import.c:65:import_set_state_nolock()) ffff99887b47e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625364.344858:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3634:x1875509206228480:12345-0@lo:38:llog_process_th.0 Request processed in 5958us (6767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625364.344872:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625364.344941:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788625364.344951:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788625364.344961:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788625364.344967:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788625364.344970:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887ca92800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788625364.344994:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206228480:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788625364.345582:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206228864:0@lo:41:osp-pre-0-1.0 00000004:00080000:2.0:1788625364.345628:0:17973:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00000100:00100000:1.0:1788625364.345636:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:01000000:2.0:1788625364.345638:0:17973:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788625364.345650:0:17973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a7b565 00000100:00100000:1.0:1788625364.345696:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206228864 00000100:00100000:1.0:1788625364.345701:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206228864 00000100:00100000:1.0:1788625364.345737:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788625364.345746:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1875509206228864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625364.345778:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788625364.345817:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1875509206228864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625364.345823:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788625364.345855:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206228864:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1788625364.347776:0:17973:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99887b64e800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.114@tcp at head 00010000:00010000:2.0:1788625364.348122:0:17973:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:2.0:1788625364.352107:0:17973:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788625364.352651:0:17973:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788625364.354302:0:17973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625364.354837:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788625364.354986:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1788625364.355618:0:17979:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788625364.355626:0:17979:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788625364.357689:0:17973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788625364.357703:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788625364.357743:0:17973:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788625364.357763:0:17973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7b56c 00000100:00080000:2.0:1788625364.357785:0:17973:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625364.357790:0:17973:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99887b64e800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625364.357829:0:17973:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874427f480 x1875509206228992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788625364.357851:0:17973:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788625364.357909:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625364.357916:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625364.357919:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625364.357922:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788625364.357923:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625364.357929:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.357931:0:17973:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788625364.357935:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788625364.357938:0:17973:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788625364.357940:0:17973:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625364.357942:0:17973:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625364.357944:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788625364.357946:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.357947:0:17973:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788625364.357950:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788625364.357954:0:17973:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788625364.357957:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.357958:0:17973:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788625364.357962:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788625364.357966:0:17973:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:01000000:2.0:1788625364.357995:0:17973:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788625364.357997:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788625364.358023:0:17973:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff99884423cd40) 00000020:00000080:2.0:1788625364.358037:0:17973:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788625364.358042:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788625364.358117:0:17973:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788625364.358126:0:17973:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788625364.358132:0:17973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a7b57a 00000100:00100000:1.0:1788625364.358289:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206228992:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788625364.358347:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206228992 offset 0 length 520: 4 00010000:00080000:2.0:1788625364.358811:0:17973:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998854e39000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.114@tcp at head 00010000:00010000:2.0:1788625364.359033:0:17973:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788625364.359118:0:17973:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788625364.359137:0:17973:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00010000:00010000:0.0:1788625364.363715:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625364.365763:0:17973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625364.367834:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788625364.368059:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788625364.372072:0:17981:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788625364.372084:0:17981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788625364.373191:0:17973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788625364.373206:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788625364.373248:0:17973:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788625364.373270:0:17973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7b581 00000100:00080000:2.0:1788625364.373281:0:17973:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625364.373288:0:17973:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998854e39000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625364.373326:0:17973:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874427ce00 x1875509206229120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788625364.373355:0:17973:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788625364.373418:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625364.373423:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.373424:0:17973:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788625364.373428:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625364.373431:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.373433:0:17973:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788625364.373436:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788625364.373437:0:17973:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788625364.373440:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625364.373442:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.373444:0:17973:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788625364.373446:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625364.373448:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.373449:0:17973:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788625364.373452:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788625364.373479:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625364.373482:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625364.373484:0:17973:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788625364.373488:0:17973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:0.0:1788625364.373675:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625364.373681:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625364.373684:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625364.373687:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788625364.373765:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206229120:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788625364.373824:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206229120 offset 0 length 520: 4 00000020:01000000:3.0:1788625364.373932:0:17969:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788625364.373963:0:17969:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788625364.373987:0:17969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b50a expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625364.373998:0:17969:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b50a expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625364.374006:0:17969:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9987427c7800 from 1 10000000:01000000:3.0:1788625364.374010:0:17969:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788625364.374039:0:17969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625364.374047:0:17969:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625364.374058:0:17969:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625364.374074:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206229248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625364.374113:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625364.374162:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885107e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788625364.374186:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206229248 00000100:00100000:0.0:1788625364.374194:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206229248 00000100:00100000:0.0:1788625364.374248:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788625364.374259:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+15:17969:x1875509206229248:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625364.374274:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625364.374288:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743ae1000/0x2d2e3b3f34a7b58f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b588 expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.374317:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743ae1000/0x2d2e3b3f34a7b58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b588 expref: 16 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.374328:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743ae1000/0x2d2e3b3f34a7b58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b588 expref: 16 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.374338:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae1000, rc 0) 00000100:00100000:0.0:1788625364.374396:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+16:17969:x1875509206229248:12345-0@lo:101:mount.lustre.0 Request processed in 139us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625364.374403:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788625364.374483:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206229248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625364.374497:0:17969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b588 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b58f expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625364.374506:0:17969:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b588 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b58f expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625364.375108:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206229376:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788625364.375164:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625364.375201:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885107e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788625364.375278:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206229376 00000100:00100000:1.0:1788625364.375284:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206229376 00000100:00100000:1.0:1788625364.375325:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788625364.375334:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+16:17969:x1875509206229376:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788625364.375350:0:17234:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788625364.375367:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788625364.375374:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788625364.375469:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+16:17969:x1875509206229376:12345-0@lo:256:mount.lustre.0 Request processed in 136us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625364.375476:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788625364.375921:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206229376:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788625364.377827:0:17969:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788625364.377860:0:17969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b588 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b58f expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625364.377873:0:17969:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b58f expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625364.377883:0:17969:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9987427c7800 from 1 10000000:01000000:3.0:1788625364.377886:0:17969:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625364.377933:0:17969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9600/0x2d2e3b3f34a7b596 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625364.377942:0:17969:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998859be9600/0x2d2e3b3f34a7b596 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625364.377952:0:17969:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998859be9600/0x2d2e3b3f34a7b596 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625364.377991:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206229504:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625364.378059:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625364.378104:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885107e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788625364.378886:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206229504 00000100:00100000:2.0:1788625364.378899:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206229504 00000100:00100000:2.0:1788625364.378995:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788625364.379007:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+16:17969:x1875509206229504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625364.379025:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625364.379044:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998744189000/0x2d2e3b3f34a7b59d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b596 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.379069:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998744189000/0x2d2e3b3f34a7b59d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b596 expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.379081:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998744189000/0x2d2e3b3f34a7b59d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b596 expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.379090:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744189000, rc 0) 00000100:00100000:2.0:1788625364.379167:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17969:x1875509206229504:12345-0@lo:101:mount.lustre.0 Request processed in 163us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625364.379174:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788625364.379483:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206229504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625364.379504:0:17969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998859be9600/0x2d2e3b3f34a7b596 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b59d expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625364.379550:0:17969:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998859be9600/0x2d2e3b3f34a7b596 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b59d expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625364.379733:0:17969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788625364.379779:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206229632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625364.379823:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625364.379871:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c88ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625364.381385:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206229632 00000100:00100000:0.0:1788625364.381401:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206229632 00000100:00100000:0.0:1788625364.381482:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788625364.381492:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17969:x1875509206229632:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625364.381677:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17969:x1875509206229632:12345-0@lo:501:mount.lustre.0 Request processed in 185us (1852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625364.381685:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788625364.382062:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206229632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625364.382114:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206229760:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625364.382188:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625364.382223:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c88ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625364.382652:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206229760 00000100:00100000:0.0:1788625364.382659:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206229760 00000100:00100000:0.0:1788625364.382702:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788625364.382711:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17969:x1875509206229760:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625364.382834:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17969:x1875509206229760:12345-0@lo:503:mount.lustre.0 Request processed in 123us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625364.382841:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788625364.382964:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206229760:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788625364.384584:0:17969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788625364.384787:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206229888:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625364.384872:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625364.384920:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743550c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625364.384990:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206229888 00000100:00100000:1.0:1788625364.384999:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206229888 00000100:00100000:1.0:1788625364.385047:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788625364.385056:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17969:x1875509206229888:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625364.385196:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17969:x1875509206229888:12345-0@lo:502:mount.lustre.0 Request processed in 140us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625364.385204:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788625364.385313:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206229888:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625364.385617:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788625364.385652:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788625364.385668:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788625364.385683:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788625364.385697:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1788625364.385710:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788625364.385737:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1788625364.385751:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1788625364.385766:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788625364.385780:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1788625364.385795:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1788625364.385835:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206230016:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625364.385876:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625364.385904:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743550c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625364.386012:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206230016 00000100:00100000:1.0:1788625364.386018:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206230016 00000100:00100000:1.0:1788625364.386056:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788625364.386064:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17969:x1875509206230016:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625364.386159:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17969:x1875509206230016:12345-0@lo:502:mount.lustre.0 Request processed in 85us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625364.386166:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788625364.386373:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206230016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625364.386421:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1788625364.386431:0:17969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788625364.388144:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625364.388168:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625364.388170:0:17983:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788625364.388179:0:17983:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9987427c7800 00000020:00000080:3.0:1788625364.388182:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625364.388196:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625364.388198:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625364.388200:0:17983:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788625364.388202:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625364.388205:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625364.388206:0:17983:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788625364.388209:0:17983:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9987427c7800 00000020:00000080:3.0:1788625364.388211:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625364.388273:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625364.388277:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625364.388279:0:17983:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788625364.388282:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625364.388284:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625364.388286:0:17983:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788625364.388290:0:17983:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9987427c7800 00000020:00000080:3.0:1788625364.388293:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625364.388311:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625364.388314:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625364.388315:0:17983:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788625364.388317:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625364.388319:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625364.388321:0:17983:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788625364.388324:0:17983:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9987427c7800 00000020:00000080:3.0:1788625364.388326:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625364.388362:0:17983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625364.388365:0:17983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625364.388367:0:17983:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788625364.388370:0:17983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1788625364.391493:0:17969:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788625364.391575:0:17969:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788625364.391600:0:17969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9600/0x2d2e3b3f34a7b596 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b59d expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.391616:0:17969:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be9600/0x2d2e3b3f34a7b596 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b59d expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625364.391687:0:17969:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788625364.391690:0:17969:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9987427c7800 10000000:01000000:0.0:1788625364.391693:0:17969:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9987427c7800 10000000:01000000:0.0:1788625364.391697:0:17969:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788625364.391703:0:17969:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9987427c7800 from 1 10000000:01000000:0.0:1788625364.391706:0:17969:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788625364.391742:0:17969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.391751:0:17969:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.391773:0:17969:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625364.391802:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206230144:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788625364.391879:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625364.391924:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206230144 00000100:00100000:0.0:1788625364.391932:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206230144 00000100:00100000:0.0:1788625364.391977:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788625364.391986:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17969:x1875509206230144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625364.391999:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625364.392013:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743ae0a00/0x2d2e3b3f34a7b5ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b5a4 expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.392038:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743ae0a00/0x2d2e3b3f34a7b5ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b5a4 expref: 18 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.392050:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743ae0a00/0x2d2e3b3f34a7b5ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b5a4 expref: 18 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.392059:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae0a00, rc 0) 00000100:00100000:0.0:1788625364.392094:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17969:x1875509206230144:12345-0@lo:101:mount.lustre.0 Request processed in 109us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625364.392101:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788625364.392395:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743550b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625364.392420:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206230144:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625364.392435:0:17969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b5ab expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625364.392451:0:17969:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b5ab expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625364.399784:0:17969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788625364.400245:0:17969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625364.400828:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788625364.400859:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788625364.400933:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788625364.400952:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788625364.400977:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788625364.401004:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788625364.401018:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788625364.401031:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788625364.401044:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788625364.401058:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788625364.401072:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788625364.401085:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788625364.401098:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788625364.401112:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788625364.401127:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788625364.401140:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788625364.401167:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788625364.401182:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788625364.401196:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788625364.401223:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788625364.401241:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788625364.401271:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788625364.401285:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788625364.401297:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788625364.401308:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788625364.401319:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788625364.401344:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788625364.401359:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788625364.401378:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788625364.401383:0:17969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788625364.401485:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206230272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625364.401589:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625364.401663:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206230272 00000100:00100000:3.0:1788625364.401671:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206230272 00000100:00100000:3.0:1788625364.401726:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788625364.401736:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17969:x1875509206230272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625364.401863:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17969:x1875509206230272:12345-0@lo:501:mount.lustre.0 Request processed in 129us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625364.401871:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788625364.401916:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c88e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788625364.401939:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206230272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625364.401976:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206230400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625364.402019:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625364.402038:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c88e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788625364.402255:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206230400 00000100:00100000:0.0:1788625364.402262:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206230400 00000100:00100000:0.0:1788625364.402299:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788625364.402308:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17969:x1875509206230400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625364.402398:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17969:x1875509206230400:12345-0@lo:503:mount.lustre.0 Request processed in 91us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625364.402406:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788625364.402458:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206230400:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788625364.402884:0:17969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788625364.402943:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206230528:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625364.402985:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625364.403017:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206230528 00000100:00100000:0.0:1788625364.403021:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206230528 00000100:00100000:0.0:1788625364.403045:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788625364.403051:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17969:x1875509206230528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625364.403132:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17969:x1875509206230528:12345-0@lo:502:mount.lustre.0 Request processed in 80us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625364.403139:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788625364.403196:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743550b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625364.403210:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206230528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625364.403365:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788625364.403397:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1788625364.403412:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1788625364.403425:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1788625364.403439:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1788625364.403453:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1788625364.403466:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1788625364.403478:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1788625364.403489:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1788625364.403500:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1788625364.403512:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1788625364.403565:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1788625364.403578:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1788625364.403589:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1788625364.403602:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1788625364.403615:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1788625364.403629:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1788625364.403643:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1788625364.403656:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1788625364.403668:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1788625364.403679:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1788625364.403691:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1788625364.403702:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1788625364.403714:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1788625364.403726:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1788625364.403738:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1788625364.403750:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1788625364.403773:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1788625364.403785:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1788625364.403795:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1788625364.403805:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1788625364.403815:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1788625364.403826:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1788625364.403838:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1788625364.403858:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1788625364.403869:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1788625364.403881:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1788625364.403893:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1788625364.403905:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1788625364.403918:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1788625364.403931:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1788625364.403944:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1788625364.403958:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1788625364.403983:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1788625364.403999:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1788625364.404011:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1788625364.404024:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1788625364.404037:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1788625364.404074:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206230656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625364.418905:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625364.418968:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff998848acba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625364.419088:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206230656 00000100:00100000:0.0:1788625364.419099:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206230656 00000100:00100000:0.0:1788625364.419165:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788625364.419178:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17969:x1875509206230656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625364.419330:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17969:x1875509206230656:12345-0@lo:502:mount.lustre.0 Request processed in 156us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625364.419338:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788625364.419565:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206230656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788625364.419821:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788625364.419856:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788625364.419896:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206230784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625364.419947:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625364.419984:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206230784 00000100:00100000:3.0:1788625364.419989:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206230784 00000100:00100000:3.0:1788625364.420029:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788625364.420039:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17969:x1875509206230784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625364.420129:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17969:x1875509206230784:12345-0@lo:502:mount.lustre.0 Request processed in 92us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625364.420136:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788625364.420191:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c88e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788625364.420205:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206230784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788625364.420264:0:17969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788625364.420273:0:17969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788625364.422098:0:17988:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788625364.422115:0:17988:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff99887da5b380) 00000020:00000080:1.0:1788625364.422140:0:17988:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788625364.422258:0:17988:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9987427c7800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788625364.422262:0:17988:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9987427c7800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788625364.422265:0:17988:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9987427c7800 3 00010000:00080000:1.0:1788625364.422298:0:17988:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998741e09000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.114@tcp at head 00010000:00010000:1.0:1788625364.424006:0:17988:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788625364.427961:0:17988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788625364.428008:0:17988:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788625364.428021:0:17988:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2d2e3b3f34a7b5b9 00000100:00080000:1.0:1788625364.428033:0:17988:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788625364.428040:0:17988:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff998741e09000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625364.428080:0:17988:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874407aa00 x1875509206230912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625364.431546:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875509206230912:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788625364.431654:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788625364.432609:0:17988:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788625364.436334:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206230912 00000100:00100000:0.0:1788625364.436351:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206230912 00000100:00100000:0.0:1788625364.436413:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625364.436422:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875509206230912:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788625364.436456:0:17241:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:0.0:1788625364.436548:0:17241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2d2e3b3f34a7b5c0 00000004:00100000:0.0:1788625364.436567:0:17241:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788625364.436609:0:17241:0:(import.c:65:import_set_state_nolock()) ffff998852348000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625364.436711:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875509206230912:12345-0@lo:38:llog_process_th.0 Request processed in 289us (5056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625364.436718:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788625364.436751:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625364.436757:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625364.436760:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625364.436763:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1788625364.436809:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99874407aa00 x1875509206230912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625364.436822:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788625364.436831:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788625364.436840:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788625364.436845:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788625364.436848:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998741e09000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788625364.436853:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875509206230912:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788625364.438323:0:17988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1788625364.441222:0:17969:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788625364.441289:0:17969:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788625364.441311:0:17969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b5ab expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625364.441324:0:17969:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b5ab expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788625364.442482:0:17969:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788625364.442485:0:17969:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788625364.442487:0:17969:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625364.442488:0:17969:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625364.442490:0:17969:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625364.442491:0:17969:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625364.442493:0:17969:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788625364.442494:0:17969:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625364.442496:0:17969:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788625364.442499:0:17969:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788625364.442503:0:17969:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788625364.442504:0:17969:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788625364.442505:0:17969:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625364.442506:0:17969:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625364.442508:0:17969:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625364.442509:0:17969:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625364.442510:0:17969:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788625364.442511:0:17969:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625364.442512:0:17969:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788625364.442552:0:17969:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788625364.442574:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206231040:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788625364.442646:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625364.442691:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c88ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625364.443336:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206231040 00000100:00100000:0.0:1788625364.443346:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206231040 00000100:00100000:0.0:1788625364.443392:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788625364.443402:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17969:x1875509206231040:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788625364.443442:0:17234:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788625364.443457:0:17234:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788625364.450350:0:17219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788625364.450613:0:17234:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788625364.450665:0:17234:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788625364.453731:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17969:x1875509206231040:12345-0@lo:253:mount.lustre.0 Request processed in 10318us (11073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625364.453749:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788625364.453834:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17969:1875509206231040:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788625364.453852:0:17969:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788625364.453857:0:17969:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788625364.453859:0:17969:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788625364.453860:0:17969:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625364.453862:0:17969:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625364.453863:0:17969:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625364.453865:0:17969:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625364.453866:0:17969:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625364.453868:0:17969:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625364.453869:0:17969:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788625364.453889:0:17969:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788625364.460539:0:17255:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788625364.460551:0:17255:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788625364.460633:0:17255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9988412e4800/0x2d2e3b3f34a7b5c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625364.460657:0:17255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9988412e5c00/0x2d2e3b3f34a7b4cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b4c4 expref: 17 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625364.460666:0:17255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998743ae1000/0x2d2e3b3f34a7b58f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b588 expref: 17 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625364.460675:0:17255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9988412e4800/0x2d2e3b3f34a7b5c7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625364.460729:0:17255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998743ae1000/0x2d2e3b3f34a7b58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7b588 expref: 17 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625364.460746:0:17255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998743ae1000/0x2d2e3b3f34a7b58f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b588 expref: 17 pid: 17232 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625364.460785:0:17255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17255:1875509206231168:0@lo:104: 00000100:00100000:1.0:1788625364.460880:0:17255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788625364.460948:0:17255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9988412e5c00/0x2d2e3b3f34a7b4cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7b4c4 expref: 17 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625364.460958:0:17255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9988412e5c00/0x2d2e3b3f34a7b4cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b4c4 expref: 17 pid: 17232 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625364.460967:0:17255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17255:1875509206231296:0@lo:104: 00000100:00100000:1.0:1788625364.460990:0:17255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625364.461004:0:17255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988434d5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788625364.462183:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206231168 00000100:00100000:2.0:1788625364.462402:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206231168 00000100:00100000:2.0:1788625364.462444:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206231296 00000100:00100000:2.0:1788625364.462447:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206231296 00000100:00100000:2.0:1788625364.462465:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625364.462475:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+4:17255:x1875509206231168:12345-0@lo:104: 00010000:00010000:2.0:1788625364.462493:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b58f expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.463046:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625364.463053:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+4:17255:x1875509206231168:12345-0@lo:104: Request processed in 580us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625364.463061:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625364.463087:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625364.463094:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+3:17255:x1875509206231296:12345-0@lo:104: 00010000:00010000:2.0:1788625364.463103:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b4c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b4cb expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.463144:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788625364.463161:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+3:17255:x1875509206231296:12345-0@lo:104: Request processed in 69us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625364.463167:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788625364.463184:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625364.463190:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b58f expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.463198:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9200 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625364.463203:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7b58f expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.463212:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7b58f expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625364.463221:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7b58f expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625364.463228:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788625364.463270:0:17227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b588 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b58f expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625364.463619:0:17255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17255:1875509206231168:0@lo:104: 00000100:00100000:0.0:1788625364.463631:0:17255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17255:1875509206231296:0@lo:104: 00010000:00010000:0.0:1788625364.463652:0:17255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9988412e4800/0x2d2e3b3f34a7b5c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.463715:0:17227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788625364.463771:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206231424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625364.463818:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625364.463894:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b588 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b58f expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.463912:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b588 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b58f expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.463924:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625364.463928:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b4c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b4cb expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.463934:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1c00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625364.463937:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b4c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7b4cb expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.463944:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b4c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7b4cb expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625364.463950:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b4c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7b4cb expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625364.463954:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788625364.463988:0:17227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b4c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b4cb expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.463995:0:17227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788625364.464109:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625364.464116:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206231552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625364.464140:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625364.464243:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b4c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b4cb expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.464251:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b4c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b4cb expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.464268:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625364.464343:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625364.464345:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625364.464353:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625364.464364:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206231424 00000100:00100000:2.0:1788625364.464370:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206231424 00010000:00010000:2.0:1788625364.464395:0:17224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998743ae1000/0x2d2e3b3f34a7b58f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b588 expref: 18 pid: 17232 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625364.464417:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206231552 00000100:00100000:2.0:1788625364.464420:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206231552 00010000:00010000:2.0:1788625364.464429:0:17224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9988412e5c00/0x2d2e3b3f34a7b4cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b4c4 expref: 19 pid: 17232 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625364.464442:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625364.464449:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:3635:x1875509206231424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625364.464461:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625364.464467:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998743ae1000/0x2d2e3b3f34a7b58f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b588 expref: 19 pid: 17232 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.464478:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998743ae1000/0x2d2e3b3f34a7b58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b588 expref: 19 pid: 17232 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.464495:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743ae1000/0x2d2e3b3f34a7b58f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b588 expref: 19 pid: 17232 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.464508:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625364.465058:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:3635:x1875509206231424:12345-0@lo:103:ldlm_bl.0 Request processed in 607us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625364.465067:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625364.465086:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625364.465095:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:3635:x1875509206231552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625364.465116:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625364.465122:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9988412e5c00/0x2d2e3b3f34a7b4cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b4c4 expref: 17 pid: 17232 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.465133:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9988412e5c00/0x2d2e3b3f34a7b4cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b4c4 expref: 17 pid: 17232 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.465157:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e5c00/0x2d2e3b3f34a7b4cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b4c4 expref: 17 pid: 17232 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.465173:0:17224:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9988412e4800/0x2d2e3b3f34a7b5c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.465183:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e4800/0x2d2e3b3f34a7b5c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788625364.465199:0:17224:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004648846s 00010000:00010000:2.0:1788625364.465204:0:17224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9988412e4800/0x2d2e3b3f34a7b5c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.465211:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9988412e4800/0x2d2e3b3f34a7b5c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.465219:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9988412e4800/0x2d2e3b3f34a7b5c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.465226:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9988412e4800/0x2d2e3b3f34a7b5c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.465231:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625364.465236:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9988412e4800/0x2d2e3b3f34a7b5c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.465249:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9988412e4800/0x2d2e3b3f34a7b5c7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.465267:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9988412e4800/0x2d2e3b3f34a7b5c7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.465384:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625364.465413:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+16:3635:x1875509206231552:12345-0@lo:103:ldlm_bl.0 Request processed in 320us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625364.465420:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788625364.465467:0:17255:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9988412e4800/0x2d2e3b3f34a7b5c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.465475:0:17255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9988412e4800/0x2d2e3b3f34a7b5c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625364.465482:0:17255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e4800/0x2d2e3b3f34a7b5c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625364.465707:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206231424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625364.465729:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206231552:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1788625364.467067:0:17969:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788625364.467242:0:17993:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788625364.467246:0:17993:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788625364.469928:0:17994:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788625364.475695:0:17969:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1788625364.475821:0:17994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625364.481868:0:17994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788625364.481956:0:17994:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1788625364.485792:0:17995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744079c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17995:1875509206231680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788625364.485870:0:17995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625364.485912:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206231680 00000100:00100000:1.0:1788625364.485919:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206231680 00000040:01000000:2.0:1788625364.486194:0:17969:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788625364.486232:0:17969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788625364.486760:0:17969:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788625364.486768:0:17969:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788625364.486804:0:17969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788625364.487068:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625364.487079:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17995:x1875509206231680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788625364.487198:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17995:x1875509206231680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 121us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625364.487206:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625364.487242:0:17995:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c898600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625364.487270:0:17995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744079c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17995:1875509206231680:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788625364.487534:0:17995:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788625364.487575:0:17995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744079c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17995:1875509206231808:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788625364.487617:0:17995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625364.487646:0:17995:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885e645a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625364.487675:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206231808 00000100:00100000:0.0:1788625364.487684:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206231808 00000100:00100000:0.0:1788625364.487716:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788625364.487724:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17995:x1875509206231808:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788625364.487839:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17995:x1875509206231808:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 115us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625364.487856:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625364.490140:0:17995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744079c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17995:1875509206231808:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788625364.490253:0:17995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744079c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17995:1875509206231936:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788625364.490318:0:17995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625364.490353:0:17995:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885e6456c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625364.491463:0:17250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206231936 00000100:00100000:3.0:1788625364.491474:0:17250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206231936 00000100:00100000:3.0:1788625364.491549:0:17250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625364.491560:0:17250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17995:x1875509206231936:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788625364.491690:0:17250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17995:x1875509206231936:12345-0@lo:900:lod0001_rec0000.0 Request processed in 132us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625364.491698:0:17250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788625364.491752:0:17995:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998744079c00 x1875509206231936/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788625380 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625364.491768:0:17995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744079c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17995:1875509206231936:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788625364.491841:0:17995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17995:1875509206232064:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788625364.491880:0:17995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625364.491908:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206232064 00000100:00100000:3.0:1788625364.491912:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206232064 00000100:00100000:3.0:1788625364.491941:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625364.491948:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17995:x1875509206232064:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788625364.492008:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17995:x1875509206232064:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 61us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625364.492015:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625364.492033:0:17995:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c88e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625364.492047:0:17995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17995:1875509206232064:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788625364.492096:0:17995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625364.493476:0:17969:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788625364.494087:0:17969:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788625364.494133:0:17969:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788625364.494350:0:17969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788625364.498812:0:17969:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:3.0:1788625364.501299:0:17995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788625364.501395:0:17995:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788625364.501401:0:17995:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:0.0:1788625364.509296:0:17969:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788625364.521385:0:17969:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788625364.521439:0:17969:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa6ab019cb988 00100000:10000000:0.0:1788625364.521448:0:17969:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788625364.523195:0:17969:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788625364.523251:0:17969:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.114@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788625364.523270:0:17969:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788625364.523305:0:17969:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788625364.526230:0:17969:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788625364.526470:0:17969:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788625364.751053:0:17273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788625364.811597:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788625365.397027:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625365.516429:0:17997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788625365.835769:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 10000000:01000000:1.0:1788625366.292217:0:17236:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788625366.292226:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9987427c7800 from 8 10000000:01000000:1.0:1788625366.292232:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788625366.292281:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e5800/0x2d2e3b3f34a7b5ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625366.292295:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff9988412e5800/0x2d2e3b3f34a7b5ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625366.292307:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff9988412e5800/0x2d2e3b3f34a7b5ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625366.292351:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206232192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788625366.292426:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625366.292490:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885e645240 going to sleep for 11 seconds 00000100:00100000:0.0:1788625366.292677:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206232192 00000100:00100000:0.0:1788625366.292686:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206232192 00000100:00100000:0.0:1788625366.293013:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788625366.293025:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+16:17236:x1875509206232192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625366.293042:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625366.293060:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743ae0800/0x2d2e3b3f34a7b5d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b5ce expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625366.293104:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743ae0800/0x2d2e3b3f34a7b5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b5ce expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625366.293127:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743ae0800/0x2d2e3b3f34a7b5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b5ce expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625366.293137:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae0800, rc 0) 00000100:00100000:0.0:1788625366.293199:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17236:x1875509206232192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625366.293206:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788625366.293438:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206232192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625366.293455:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff9988412e5800/0x2d2e3b3f34a7b5ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b5d5 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625366.293466:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff9988412e5800/0x2d2e3b3f34a7b5ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b5d5 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625366.293602:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206232320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788625366.293643:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625366.293781:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff998848acbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625366.293828:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206232320 00000100:00100000:1.0:1788625366.293833:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206232320 00000100:00100000:1.0:1788625366.293860:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788625366.293866:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17236:x1875509206232320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788625366.293882:0:17232:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788625366.293972:0:17232:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788625366.293976:0:17232:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788625366.294280:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17236:x1875509206232320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 413us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625366.294288:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788625366.294392:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206232320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788625366.294446:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788625366.294455:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e5800/0x2d2e3b3f34a7b5ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b5d5 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625366.294464:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e5800/0x2d2e3b3f34a7b5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b5d5 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625366.294475:0:17236:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788625366.294478:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998848aae000 from 8 10000000:01000000:3.0:1788625366.294481:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788625366.294509:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b5dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625366.294889:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b5dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625366.294969:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b5dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625366.294995:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206232448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625366.295030:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625366.295057:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c46480 going to sleep for 11 seconds 00000100:00100000:1.0:1788625366.295160:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206232448 00000100:00100000:1.0:1788625366.295167:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206232448 00000100:00100000:1.0:1788625366.295212:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788625366.295220:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17236:x1875509206232448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625366.295230:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625366.295252:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b5e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b5dc expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625366.295402:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b5dc expref: 18 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625366.295417:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b5dc expref: 18 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625366.295438:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4c00, rc 0) 00000100:00100000:1.0:1788625366.295481:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17236:x1875509206232448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 262us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625366.295487:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788625366.295828:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206232448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625366.295845:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b5dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b5e3 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625366.295856:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b5dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b5e3 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625366.295907:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206232576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788625366.295940:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625366.295966:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c46480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625366.295993:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206232576 00000100:00100000:0.0:1788625366.295998:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206232576 00000100:00100000:0.0:1788625366.296035:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788625366.296046:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17236:x1875509206232576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788625366.296068:0:17234:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788625366.296246:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788625366.296250:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788625366.296449:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17236:x1875509206232576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 407us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625366.296458:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788625366.296543:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206232576:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788625366.296589:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788625366.296596:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b5dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b5e3 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625366.296605:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b5e3 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625366.411722:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625366.540228:0:17997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788625366.859816:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788625367.436618:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625367.883600:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788625368.459790:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788625368.760088:0:18240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788625368.908655:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 0 seconds 00000100:00100000:1.0:1788625369.355746:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625369.355769:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206232704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625369.355901:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625369.355973:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206232704 00000100:00100000:1.0:1788625369.355981:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206232704 00000100:00100000:1.0:1788625369.356030:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625369.356039:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206232704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625369.356088:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788625369.356136:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206232704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625369.356143:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625369.356189:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206232704:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788625369.483968:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788625369.624921:0:18292:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625369.625203:0:18292:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1788625369.875008:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788625369.875016:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788625369.875020:0:38:0:(import.c:65:import_set_state_nolock()) ffff9988449c8800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788625369.875035:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9988449c8800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625369.875073:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874427d880 x1875509206232960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788625369.875092:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625369.875096:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625369.875099:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625369.875101:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625369.875122:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625369.875126:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625369.875129:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625369.875131:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788625369.875167:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625369.875183:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206232832:0@lo:400:kworker.0 00000100:00100000:2.0:1788625369.875260:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625369.875317:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206232960:0@lo:38:kworker.0 00000100:00100000:2.0:1788625369.875349:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625369.875384:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206233088:0@lo:400:kworker.0 00000100:00100000:2.0:1788625369.875422:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625369.875442:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625369.875447:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206233216:0@lo:400:kworker.0 00000100:00100000:2.0:1788625369.875474:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625369.875561:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206232832 00000100:00100000:2.0:1788625369.875569:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206232832 00000100:00100000:2.0:1788625369.875617:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788625369.875625:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:3637:x1875509206232832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625369.875672:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:3637:x1875509206232832:12345-0@lo:400:kworker.0 Request processed in 48us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625369.875680:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788625369.875718:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206232960 00000100:00100000:2.0:1788625369.875722:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206232960 00000100:00100000:2.0:1788625369.875746:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625369.875752:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1875509206232960:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788625369.875791:0:17978:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:2.0:1788625369.875842:0:17978:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7b5ea 00000004:00100000:2.0:1788625369.875858:0:17978:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788625369.875864:0:17978:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788625369.875938:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206233088 00000100:00100000:2.0:1788625369.875942:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206233088 00000100:00100000:2.0:1788625369.875970:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206233216 00000100:00100000:2.0:1788625369.875973:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206233216 00000100:00100000:2.0:1788625369.875988:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625369.875995:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206233088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625369.876035:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206233088:12345-0@lo:400:kworker.0 Request processed in 42us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625369.876062:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625369.876076:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625369.876083:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206233216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625369.876112:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206233216:12345-0@lo:400:kworker.0 Request processed in 30us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625369.876117:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625369.876156:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206232832:0@lo:400:kworker.0 00010000:00080000:2.0:1788625369.876182:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99874427d180 x1875509206233216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625369.876194:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206233216:0@lo:400:kworker.0 00010000:00080000:2.0:1788625369.876203:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99874427e680 x1875509206233088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625369.876211:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206233088:0@lo:400:kworker.0 00000100:00080000:2.0:1788625369.884965:0:17978:0:(import.c:65:import_set_state_nolock()) ffff998743b72800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625369.885084:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1875509206232960:12345-0@lo:38:kworker.0 Request processed in 9329us (9732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625369.885097:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788625369.885263:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788625369.885274:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788625369.885281:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788625369.885283:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9988449c8800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788625369.885301:0:3634:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000614e8e9a): req@ffff99874427ea00 x1875509206225920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625369.885329:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206232960:0@lo:38:kworker.0 00000100:00100000:2.0:1788625369.885459:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625369.885476:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206233344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625369.885547:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625369.885613:0:17280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625369.885652:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625369.885670:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206233344 00000100:00100000:1.0:1788625369.885676:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206233344 00000100:00100000:2.0:1788625369.885788:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206225920 00000100:00100000:2.0:1788625369.885793:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206225920 00000100:00100000:1.0:1788625369.885837:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788625369.885847:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1875509206233344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788625369.885880:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788625369.885924:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1875509206233344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625369.885931:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788625369.885945:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788625369.885951:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17280:x1875509206225920:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788625369.886019:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17280:x1875509206225920:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 68us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625369.886026:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788625369.889534:0:17280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17280:1875509206225920:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788625369.889590:0:17280:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788625369.889643:0:17280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17280:1875509206233472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788625369.889778:0:17280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625369.889826:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885e645300 going to sleep for 11 seconds 00000100:00100000:1.0:1788625369.889844:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206233472 00000100:00100000:1.0:1788625369.890170:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206233472 00000100:00100000:1.0:1788625369.890219:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788625369.890228:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17280:x1875509206233472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788625369.890372:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17280:x1875509206233472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 145us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625369.890380:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788625369.890423:0:17280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17280:1875509206233472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788625369.890494:0:17280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17280:1875509206233600:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788625369.890543:0:17280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625369.890560:0:17280:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885e645300 going to sleep for 11 seconds 00000100:00100000:1.0:1788625369.890581:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206233600 00000100:00100000:1.0:1788625369.890585:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206233600 00000100:00100000:1.0:1788625369.890606:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788625369.890613:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17280:x1875509206233600:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788625369.890667:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17280:x1875509206233600:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 54us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625369.890674:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788625369.890700:0:17280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17280:1875509206233600:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788625369.890739:0:17280:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788625369.893535:0:17280:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000100:00100000:0.0:1788625369.893654:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206233344:0@lo:41:osp-pre-1-0.0 00000004:00080000:1.0:1788625369.893764:0:17280:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:1.0:1788625369.893771:0:17280:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1788625370.430143:0:18343:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625370.430485:0:18343:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788625370.508926:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788625371.410331:0:18391:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf1d79290 20000000:00000080:2.0:1788625371.410349:0:18391:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99884419f400 uarg=0000000000000000 20000000:01000000:2.0:1788625371.410395:0:18391:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788625371.410403:0:18391:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788625371.410408:0:18391:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788625371.414641:0:18392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788625371.415453:0:18391:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788625371.424869:0:18391:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788625371.424901:0:18391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b5f1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.424920:0:18391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998743ae1e00/0x2d2e3b3f34a7b49a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b493 expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.424927:0:18391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998744189000/0x2d2e3b3f34a7b59d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b596 expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.424953:0:18391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b5f1 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.424995:0:18391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998744189000/0x2d2e3b3f34a7b59d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7b596 expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.425021:0:18391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998744189000/0x2d2e3b3f34a7b59d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b596 expref: 17 pid: 17233 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625371.425036:0:18391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744829500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18391:1875509206233728:0@lo:104: 00000100:00100000:0.0:1788625371.425260:0:18391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625371.425379:0:18391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998743ae1e00/0x2d2e3b3f34a7b49a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7b493 expref: 17 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.425387:0:18391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998743ae1e00/0x2d2e3b3f34a7b49a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b493 expref: 17 pid: 17233 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625371.425396:0:18391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18391:1875509206233856:0@lo:104: 00000100:00100000:0.0:1788625371.425417:0:18391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625371.425568:0:18391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788625371.426147:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206233728 00000100:00100000:2.0:1788625371.426156:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206233728 00000100:00100000:0.0:1788625371.426459:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206233856 00000100:00100000:0.0:1788625371.426465:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206233856 00000100:00100000:0.0:1788625371.426483:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625371.426492:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+4:18391:x1875509206233728:12345-0@lo:104: 00010000:00010000:0.0:1788625371.426510:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998859be9600/0x2d2e3b3f34a7b596 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b59d expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.427001:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788625371.427033:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+4:18391:x1875509206233728:12345-0@lo:104: Request processed in 540us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625371.427040:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625371.427058:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625371.427065:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744828700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+3:18391:x1875509206233856:12345-0@lo:104: 00010000:00010000:0.0:1788625371.427085:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998744188000/0x2d2e3b3f34a7b493 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b49a expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.427120:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788625371.427125:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744828700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+3:18391:x1875509206233856:12345-0@lo:104: Request processed in 61us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625371.427131:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788625371.427148:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788625371.427154:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be9600/0x2d2e3b3f34a7b596 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b59d expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.427161:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9600 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625371.427166:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be9600/0x2d2e3b3f34a7b596 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7b59d expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.427175:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be9600/0x2d2e3b3f34a7b596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7b59d expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625371.427182:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be9600/0x2d2e3b3f34a7b596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7b59d expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625371.427187:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788625371.427222:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998859be9600/0x2d2e3b3f34a7b596 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b59d expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.427238:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625371.427259:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be9600/0x2d2e3b3f34a7b596 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b59d expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.427266:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be9600/0x2d2e3b3f34a7b596 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b59d expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.427285:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625371.427288:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998744188000/0x2d2e3b3f34a7b493 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b49a expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.427294:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188000 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625371.427297:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998744188000/0x2d2e3b3f34a7b493 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7b49a expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.427308:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998744188000/0x2d2e3b3f34a7b493 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7b49a expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625371.427314:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998744188000/0x2d2e3b3f34a7b493 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7b49a expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625371.427319:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788625371.427332:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998744188000/0x2d2e3b3f34a7b493 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b49a expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.427339:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625371.427350:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998744188000/0x2d2e3b3f34a7b493 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b49a expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.427357:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998744188000/0x2d2e3b3f34a7b493 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b49a expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625371.427378:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625371.427379:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625371.427381:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625371.427401:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3638:1875509206233984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625371.427440:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625371.427582:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206234112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625371.427616:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625371.427674:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206233984 00000100:00100000:2.0:1788625371.427680:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206233984 00010000:00010000:2.0:1788625371.427717:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998744189000/0x2d2e3b3f34a7b59d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b596 expref: 18 pid: 17233 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625371.427747:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206234112 00000100:00100000:2.0:1788625371.427751:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206234112 00010000:00010000:2.0:1788625371.427766:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998743ae1e00/0x2d2e3b3f34a7b49a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b493 expref: 19 pid: 17233 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625371.427778:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625371.427784:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:3638:x1875509206233984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625371.427797:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625371.427804:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998744189000/0x2d2e3b3f34a7b59d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b596 expref: 19 pid: 17233 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.427817:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998744189000/0x2d2e3b3f34a7b59d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b596 expref: 19 pid: 17233 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.427844:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625371.427871:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:3638:x1875509206233984:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625371.427890:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625371.427908:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788625371.427915:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:3635:x1875509206234112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625371.427923:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625371.427928:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998743ae1e00/0x2d2e3b3f34a7b49a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b493 expref: 18 pid: 17233 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.427936:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998743ae1e00/0x2d2e3b3f34a7b49a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b493 expref: 18 pid: 17233 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.427949:0:17225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b5f1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.427957:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b5f1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.427971:0:17225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b5f1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.427979:0:17225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b5f1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.427986:0:17225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b5f1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.427993:0:17225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b5f1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.427998:0:17225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625371.428003:0:17225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b5f1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.428028:0:17225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b5f1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.428037:0:17225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b5f1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.428048:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625371.428080:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:3635:x1875509206234112:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625371.428086:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788625371.428120:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206234112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625371.428153:0:18391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998744189000/0x2d2e3b3f34a7b59d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b596 expref: 17 pid: 17233 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625371.428164:0:18391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744829500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18391:1875509206233728:0@lo:104: 00010000:00010000:2.0:1788625371.428174:0:18391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743ae1e00/0x2d2e3b3f34a7b49a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b493 expref: 16 pid: 17233 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625371.428181:0:18391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18391:1875509206233856:0@lo:104: 00010000:00010000:2.0:1788625371.428199:0:18391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b5f1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.428209:0:18391:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b5f1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.428215:0:18391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b5f1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625371.428232:0:18391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b5f1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625371.428511:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3638:1875509206233984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625371.428855:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625371.536509:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625372.557822:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788625372.939765:0:17236:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788625372.939773:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9987427c7800 from 13 10000000:01000000:1.0:1788625372.939778:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625372.939828:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4600/0x2d2e3b3f34a7b5f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625372.939842:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff9988412e4600/0x2d2e3b3f34a7b5f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625372.939854:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff9988412e4600/0x2d2e3b3f34a7b5f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625372.939903:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744185880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206234240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788625372.939991:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625372.940039:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885e6453c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625372.940394:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206234240 00000100:00100000:0.0:1788625372.940412:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206234240 00000100:00100000:0.0:1788625372.940497:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788625372.940510:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+16:17236:x1875509206234240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625372.940569:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625372.940594:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b5ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b5f8 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625372.940800:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b5ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b5f8 expref: 17 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625372.940818:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b5ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b5f8 expref: 17 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625372.940828:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae1800, rc 0) 00000100:00100000:2.0:1788625372.940894:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17236:x1875509206234240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 387us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625372.940904:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788625372.941027:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744185880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206234240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625372.941072:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff9988412e4600/0x2d2e3b3f34a7b5f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b5ff expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625372.941082:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff9988412e4600/0x2d2e3b3f34a7b5f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b5ff expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625372.941157:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206234368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625372.941189:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625372.941388:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887266bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625372.943821:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206234368 00000100:00100000:2.0:1788625372.943836:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206234368 00000100:00100000:2.0:1788625372.944007:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788625372.944019:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17236:x1875509206234368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625372.944220:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17236:x1875509206234368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (3030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625372.944229:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788625372.944339:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206234368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625372.944396:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744184700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206234496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625372.944453:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625372.944488:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885e645540 going to sleep for 11 seconds 00000100:00100000:2.0:1788625372.944628:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206234496 00000100:00100000:2.0:1788625372.944633:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206234496 00000100:00100000:2.0:1788625372.944662:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788625372.944669:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17236:x1875509206234496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625372.944861:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17236:x1875509206234496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625372.944881:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788625372.944974:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744184700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206234496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788625372.946471:0:18460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788625372.946889:0:17236:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788625372.946918:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625372.946934:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4600/0x2d2e3b3f34a7b5f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b5ff expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625372.946948:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e4600/0x2d2e3b3f34a7b5f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b5ff expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625372.946963:0:17236:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788625372.946966:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998848aae000 from 13 10000000:01000000:1.0:1788625372.946970:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625372.947342:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e5e00/0x2d2e3b3f34a7b606 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625372.947353:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff9988412e5e00/0x2d2e3b3f34a7b606 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625372.947367:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff9988412e5e00/0x2d2e3b3f34a7b606 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625372.947403:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744187100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206234624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788625372.947562:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625372.947629:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885e6459c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625372.948342:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206234624 00000100:00100000:2.0:1788625372.948354:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206234624 00000100:00100000:2.0:1788625372.948423:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788625372.948434:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+17:17236:x1875509206234624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625372.948453:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625372.948471:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998744188600/0x2d2e3b3f34a7b60d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b606 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625372.948502:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998744188600/0x2d2e3b3f34a7b60d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b606 expref: 18 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625372.948543:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998744188600/0x2d2e3b3f34a7b60d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b606 expref: 18 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625372.948555:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188600, rc 0) 00000100:00100000:2.0:1788625372.948629:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17236:x1875509206234624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625372.948636:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788625372.949197:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744187100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206234624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625372.949330:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff9988412e5e00/0x2d2e3b3f34a7b606 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b60d expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625372.949342:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff9988412e5e00/0x2d2e3b3f34a7b606 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b60d expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625372.949443:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206234752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625372.949494:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625372.949615:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887266bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625372.949825:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206234752 00000100:00100000:0.0:1788625372.949832:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206234752 00000100:00100000:0.0:1788625372.949881:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788625372.949891:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860803050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17236:x1875509206234752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625372.950079:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860803050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17236:x1875509206234752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 188us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625372.950087:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788625372.950178:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206234752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625372.950226:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206234880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625372.950282:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625372.950304:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887266bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625372.950756:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206234880 00000100:00100000:0.0:1788625372.950761:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206234880 00000100:00100000:0.0:1788625372.950784:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788625372.950790:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17236:x1875509206234880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625372.950895:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:17236:x1875509206234880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625372.950902:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788625372.951026:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206234880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788625372.952084:0:18461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788625372.952421:0:17236:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788625372.952445:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788625372.952457:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e5e00/0x2d2e3b3f34a7b606 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b60d expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625372.952471:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e5e00/0x2d2e3b3f34a7b606 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b60d expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625373.583368:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625374.475804:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206235008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625374.477791:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625374.477991:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206235008 00000100:00100000:1.0:1788625374.478007:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206235008 00000100:00100000:1.0:1788625374.478088:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788625374.478100:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206235008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625374.478157:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788625374.478273:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206235008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625374.478281:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625374.478869:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206235008:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788625374.605640:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625374.987735:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625374.987769:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206235136:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788625374.991973:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625374.991982:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625374.991986:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625374.991990:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788625374.992171:0:17273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788625374.992299:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625374.992324:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206235264:0@lo:400:kworker.0 00000100:00100000:3.0:1788625374.992421:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625374.992491:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206235392:0@lo:400:kworker.0 00000100:00080000:2.0:1788625374.992795:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625374.992799:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625374.992827:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625374.992831:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788625374.993328:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206235520:0@lo:400:kworker.0 00000100:00100000:0.0:1788625374.993467:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625374.993602:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206235520 00000100:00100000:0.0:1788625374.993610:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206235520 00000100:00100000:0.0:1788625374.993656:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625374.993663:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206235520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625374.993723:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206235520:12345-0@lo:400:kworker.0 Request processed in 60us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625374.993730:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788625374.993767:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99874427fb80 x1875509206235520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625374.993780:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206235520:0@lo:400:kworker.0 00000100:00100000:0.0:1788625374.993879:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625374.994117:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206235136 00000100:00100000:0.0:1788625374.994122:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206235136 00000100:00100000:0.0:1788625374.994171:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788625374.994177:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1875509206235136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625374.994205:0:17978:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788625374.994267:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1875509206235136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625374.994273:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788625374.994305:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206235136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625374.994323:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206235776:0@lo:400:kworker.0 00000100:00100000:0.0:1788625374.994350:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625374.994608:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625374.994970:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206235264 00000100:00100000:3.0:1788625374.994979:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206235264 00000100:00100000:0.0:1788625374.995038:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206235776 00000100:00100000:0.0:1788625374.995046:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206235776 00000100:00100000:0.0:1788625374.995078:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788625374.995094:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206235776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625374.995127:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788625374.995144:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860801c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:3637:x1875509206235264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625374.995151:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206235776:12345-0@lo:400:kworker.0 Request processed in 61us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625374.995161:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788625374.995203:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99874427c700 x1875509206235776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625374.995218:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206235776:0@lo:400:kworker.0 00000100:00100000:3.0:1788625374.995225:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860801c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:3637:x1875509206235264:12345-0@lo:400:kworker.0 Request processed in 83us (2798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625374.995234:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788625374.995285:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206235648:0@lo:400:kworker.0 00000100:00100000:3.0:1788625374.995321:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625374.995366:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206235264:0@lo:400:kworker.0 00000100:00100000:3.0:1788625374.995797:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206235392 00000100:00100000:3.0:1788625374.995803:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206235392 00000100:00100000:3.0:1788625374.995828:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206235648 00000100:00100000:3.0:1788625374.995831:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206235648 00000100:00100000:3.0:1788625374.995847:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788625374.995854:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206235392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625374.995908:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206235392:12345-0@lo:400:kworker.0 Request processed in 53us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625374.995915:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788625374.995928:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788625374.995946:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206235648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625374.995980:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206235648:12345-0@lo:400:kworker.0 Request processed in 46us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625374.995986:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788625374.996488:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625364/real 1788625364] req@ffff99874427ce00 x1875509206229120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625374 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625374.996551:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99874427ce00 x1875509206229120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625374 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625374.996565:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625364/real 1788625364] req@ffff99874427f480 x1875509206228992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625374 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625374.996578:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99874427f480 x1875509206228992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625374 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788625374.996605:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998854e39000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788625374.996625:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788625374.996629:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206229120:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788625374.996636:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b64e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788625374.996641:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788625374.996644:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206228992:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788625374.996838:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206235648:0@lo:400:kworker.0 00000100:00100000:3.0:1788625374.996881:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206235392:0@lo:400:kworker.0 00000100:00080000:1.0:1788625374.998139:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625374.998149:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788625374.998151:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625374.998154:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788625374.998158:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625374.998162:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788625374.998166:0:37:0:(import.c:65:import_set_state_nolock()) ffff99887b64e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625374.998174:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 485 00000100:00080000:1.0:1788625374.998180:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788625374.998186:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99887b64e800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625374.998227:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998744184380 x1875509206235904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788625374.998261:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625374.998265:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788625374.998267:0:37:0:(import.c:65:import_set_state_nolock()) ffff998854e39000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625374.998271:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 485 00000100:00080000:1.0:1788625374.998274:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788625374.998277:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998854e39000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625374.998289:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998744184000 x1875509206236032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625374.998403:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206235904:0@lo:8:kworker.0 00000400:00000100:3.0:1788625374.998483:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206235904 offset 0 length 520: 4 00000100:00100000:3.0:1788625374.998553:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206236032:0@lo:8:kworker.0 00000400:00000100:3.0:1788625374.998575:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206236032 offset 0 length 520: 4 00010000:00010000:0.0:1788625375.627964:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788625376.019679:0:17970:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788625376.653097:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625376.780943:0:17997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788625377.048880:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625362/real 1788625362] req@ffff99874407a680 x1875509206227200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625377 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625377.048939:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99874407a680 x1875509206227200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625377 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625377.048970:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625362/real 1788625362] req@ffff998744078000 x1875509206226944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625377 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625377.048985:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998744078000 x1875509206226944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625377 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788625377.049010:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998844cd0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625377.049042:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788625377.049048:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206227200:0@lo:8:kworker.0 00000100:00080000:3.0:1788625377.049056:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998874b50000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625377.049063:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788625377.049066:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206226944:0@lo:8:kworker.0 00000100:00080000:1.0:1788625377.050226:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625377.050233:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788625377.050236:0:37:0:(import.c:65:import_set_state_nolock()) ffff998844cd0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625377.050258:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:1.0:1788625377.050264:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788625377.050272:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff998844cd0800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625377.050298:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998744184e00 x1875509206236416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788625377.050314:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625377.050317:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788625377.050318:0:37:0:(import.c:65:import_set_state_nolock()) ffff998874b50000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625377.050321:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:1.0:1788625377.050323:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788625377.050326:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff998874b50000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625377.050335:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998744186d80 x1875509206236544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788625377.050378:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625377.050382:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788625377.050385:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625377.050388:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788625377.050421:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206236288:0@lo:400:kworker.0 00000100:00100000:1.0:1788625377.050491:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625377.050564:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788625377.050571:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744185f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3636:1875509206236160:0@lo:400:kworker.0 00000100:00100000:1.0:1788625377.050613:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625377.050643:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206236928:0@lo:400:kworker.0 00000100:00100000:1.0:1788625377.050677:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625377.050704:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744186a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206236800:0@lo:400:kworker.0 00000100:00100000:1.0:1788625377.050727:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625377.050752:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625377.050758:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206236672:0@lo:400:kworker.0 00000100:00100000:1.0:1788625377.050779:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625377.050819:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206236288 00000100:00100000:1.0:1788625377.050829:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206236288 00000100:00100000:1.0:1788625377.050879:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206236800 00000100:00100000:1.0:1788625377.050883:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206236800 00000100:00100000:1.0:1788625377.050915:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788625377.050925:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206236288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625377.050982:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206236288:12345-0@lo:400:kworker.0 Request processed in 58us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625377.050991:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788625377.051008:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625377.051020:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206236800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625377.051059:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206236800:12345-0@lo:400:kworker.0 Request processed in 44us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625377.051065:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625377.051088:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206236928 00000100:00100000:1.0:1788625377.051092:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206236928 00000100:00100000:1.0:1788625377.051136:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206236672 00000100:00100000:1.0:1788625377.051140:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206236672 00000100:00100000:1.0:1788625377.051166:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625377.051183:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206236928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625377.051187:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744184e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206236416:0@lo:8:kworker.0 00000400:00000100:3.0:1788625377.051255:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206236416 offset 0 length 520: 4 00000100:00100000:3.0:1788625377.051289:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744186d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206236544:0@lo:8:kworker.0 00000400:00000100:3.0:1788625377.051308:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206236544 offset 0 length 520: 4 00000100:00100000:2.0:1788625377.051447:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206236160 00000100:00100000:2.0:1788625377.051458:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206236160 00000100:00100000:2.0:1788625377.051534:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788625377.051545:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:3636:x1875509206236160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625377.051608:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:3636:x1875509206236160:12345-0@lo:400:kworker.0 Request processed in 64us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625377.051617:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788625377.051757:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744185f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3636:1875509206236160:0@lo:400:kworker.0 00000100:00100000:2.0:1788625377.051776:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206236288:0@lo:400:kworker.0 00000100:00100000:2.0:1788625377.051817:0:17239:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788625377.051827:0:17239:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788625377.054155:0:17240:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788625377.054180:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625377.054200:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206236672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625377.054315:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206236672:12345-0@lo:400:kworker.0 Request processed in 123us (3534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625377.054323:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788625377.054396:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998744185500 x1875509206236672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625377.054416:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206236672:0@lo:400:kworker.0 00000100:00100000:2.0:1788625377.054442:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744186a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206236800:0@lo:400:kworker.0 00000100:00100000:1.0:1788625377.057986:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206236928:12345-0@lo:400:kworker.0 Request processed in 6798us (7292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625377.058023:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788625377.058285:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998744185180 x1875509206236928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625377.058310:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206236928:0@lo:400:kworker.0 00010000:00010000:2.0:1788625377.676942:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788625377.912306:0:18740:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788625377.912311:0:18740:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788625377.912312:0:18740:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788625377.912441:0:18740:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff998743b76800 00000020:01000004:2.0:1788625377.912458:0:18740:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788625377.912473:0:18740:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788625377.912486:0:18740:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff998844238000) 00000020:00000080:2.0:1788625377.912504:0:18740:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788625377.980173:0:18740:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788625377.984854:0:18740:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788625377.985513:0:18740:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788625377.987149:0:18740:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788625377.987428:0:18740:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788625377.987711:0:18740:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788625377.988211:0:18740:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1788625377.990743:0:18740:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788625377.991111:0:18740:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788625377.991127:0:18740:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788625377.991142:0:18740:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2d2e3b3f34a7b61b 00000020:01000004:1.0:1788625377.991149:0:18740:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788625377.991174:0:18740:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.114@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788625377.991178:0:18740:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788625377.991184:0:18740:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788625377.991189:0:18740:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788625377.991200:0:18740:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99887da5cd40) 00000020:00000080:1.0:1788625377.991212:0:18740:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788625377.999480:0:18740:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625378.000867:0:18740:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788625378.000887:0:18740:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788625378.001747:0:18740:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788625378.001758:0:18740:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788625378.006324:0:18740:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788625378.006337:0:18740:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788625378.009446:0:18740:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788625378.010172:0:18740:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788625378.010183:0:18740:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788625378.011843:0:18740:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788625378.011864:0:18740:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788625378.039486:0:18740:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788625378.039851:0:18740:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788625378.039858:0:18740:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788625378.042055:0:18740:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788625378.042073:0:18740:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788625378.043461:0:18740:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788625378.043475:0:18740:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788625378.046344:0:18740:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788625378.046963:0:18740:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788625378.046971:0:18740:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788625378.048161:0:18740:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788625378.048174:0:18740:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788625378.082740:0:18740:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625378.083130:0:18740:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788625378.083137:0:18740:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788625378.084850:0:18740:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788625378.084860:0:18740:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788625378.085499:0:18740:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788625378.085561:0:18740:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788625378.085568:0:18740:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788625378.102019:0:18740:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.114@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788625378.102059:0:18740:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.114@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788625378.102068:0:18740:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788625378.102069:0:18740:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788625378.102070:0:18740:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625378.102071:0:18740:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625378.102073:0:18740:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625378.102074:0:18740:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625378.102075:0:18740:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788625378.102076:0:18740:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625378.102078:0:18740:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788625378.102081:0:18740:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788625378.102202:0:18740:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788625378.102204:0:18740:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788625378.102205:0:18740:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625378.102206:0:18740:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625378.102207:0:18740:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625378.102208:0:18740:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625378.102209:0:18740:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788625378.102210:0:18740:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625378.102211:0:18740:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788625378.102239:0:18740:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788625378.102259:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237056:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788625378.102332:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625378.102384:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625378.102677:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206237056 00000100:00100000:3.0:1788625378.102686:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206237056 00000100:00100000:3.0:1788625378.102794:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788625378.102803:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:18740:x1875509206237056:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788625378.102834:0:17232:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788625378.102837:0:17232:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788625378.102841:0:17232:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788625378.103312:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:18740:x1875509206237056:12345-0@lo:253:mount.lustre.0 Request processed in 508us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625378.103321:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788625378.103405:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237056:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788625378.103418:0:18740:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788625378.103420:0:18740:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788625378.103421:0:18740:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788625378.103422:0:18740:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625378.103424:0:18740:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625378.103425:0:18740:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625378.103426:0:18740:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625378.103427:0:18740:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788625378.103429:0:18740:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625378.103430:0:18740:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788625378.103449:0:18740:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998743b76800 from lustre-OST0000 10000000:01000000:0.0:1788625378.103505:0:18740:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788625378.103508:0:18740:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788625378.103545:0:18740:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99887cb18000 local copy 00010000:00010000:0.0:1788625378.103555:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625378.103664:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625378.103699:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625378.104307:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625378.104395:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206237184 00000100:00100000:2.0:1788625378.104402:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206237184 00000100:00100000:2.0:1788625378.104439:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788625378.104447:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:18740:x1875509206237184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625378.104581:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:18740:x1875509206237184:12345-0@lo:501:mount.lustre.0 Request processed in 134us (881us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625378.104588:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788625378.104792:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237184:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788625378.104811:0:18740:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788625378.104833:0:18740:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788625378.104842:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625378.104853:0:18740:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625378.104892:0:18740:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998743b76800 10000000:01000000:0.0:1788625378.104897:0:18740:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788625378.104903:0:18740:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788625378.104906:0:18740:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788625378.104910:0:18740:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788625378.104913:0:18740:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788625378.104951:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625378.104959:0:18740:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625378.104968:0:18740:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625378.104995:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788625378.105038:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625378.105056:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625378.105264:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206237312 00000100:00100000:2.0:1788625378.105270:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206237312 00000100:00100000:2.0:1788625378.105335:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788625378.105344:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+18:18740:x1875509206237312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625378.105352:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625378.105365:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998744189e00/0x2d2e3b3f34a7b630 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b629 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.105387:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998744189e00/0x2d2e3b3f34a7b630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b629 expref: 19 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.105405:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998744189e00/0x2d2e3b3f34a7b630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b629 expref: 19 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.105414:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744189e00, rc 0) 00000100:00100000:2.0:1788625378.105454:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:18740:x1875509206237312:12345-0@lo:101:mount.lustre.0 Request processed in 112us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625378.105461:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788625378.105690:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625378.105704:0:18740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b630 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625378.105713:0:18740:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b630 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625378.107196:0:18740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788625378.107900:0:18740:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788625378.110762:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788625378.110930:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788625378.111139:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788625378.111166:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788625378.111185:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788625378.111203:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788625378.111251:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788625378.111260:0:18740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788625378.111383:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625378.111457:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625378.111587:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788625378.111764:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206237440 00000100:00100000:2.0:1788625378.111772:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206237440 00000100:00100000:2.0:1788625378.111827:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788625378.111837:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:18740:x1875509206237440:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625378.112270:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:18740:x1875509206237440:12345-0@lo:501:mount.lustre.0 Request processed in 433us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625378.112279:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788625378.112402:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625378.112440:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625378.112482:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625378.112513:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788625378.112692:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206237568 00000100:00100000:1.0:1788625378.112702:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206237568 00000100:00100000:1.0:1788625378.112739:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788625378.112745:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:18740:x1875509206237568:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625378.114165:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:18740:x1875509206237568:12345-0@lo:503:mount.lustre.0 Request processed in 1414us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625378.114176:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788625378.114270:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237568:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788625378.115197:0:18740:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788625378.115314:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625378.115369:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625378.115452:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c88ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625378.115498:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206237696 00000100:00100000:0.0:1788625378.115505:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206237696 00000100:00100000:0.0:1788625378.115799:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788625378.115809:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:18740:x1875509206237696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625378.119599:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:18740:x1875509206237696:12345-0@lo:502:mount.lustre.0 Request processed in 3782us (4220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625378.119621:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788625378.137766:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788625378.138860:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788625378.138917:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788625378.139072:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788625378.139167:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788625378.139185:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788625378.139199:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788625378.139213:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788625378.139225:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788625378.139315:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788625378.139332:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788625378.139345:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788625378.139372:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788625378.139425:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625378.139507:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625378.139588:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c46180 going to sleep for 11 seconds 00000100:00100000:0.0:1788625378.140129:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206237824 00000100:00100000:0.0:1788625378.140139:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206237824 00000100:00100000:0.0:1788625378.140204:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788625378.140216:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:18740:x1875509206237824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625378.140362:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:18740:x1875509206237824:12345-0@lo:502:mount.lustre.0 Request processed in 148us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625378.140371:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788625378.141192:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788625378.141764:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788625378.141778:0:18740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788625378.147881:0:18757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788625378.147894:0:18757:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788625378.147901:0:18757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625378.147904:0:18757:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788625378.147912:0:18757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625378.149159:0:18757:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99887cb1cd40) 00000020:00000080:0.0:1788625378.149192:0:18757:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788625378.149205:0:18757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788625378.149372:0:18757:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998743b76800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788625378.149381:0:18757:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788625378.149390:0:18757:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2d2e3b3f34a7b63e 00010000:00010000:2.0:1788625378.162729:0:18757:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788625378.163473:0:18757:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1788625378.174213:0:18757:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788625378.179553:0:18757:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788625378.179567:0:18757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625378.179575:0:18757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625378.179592:0:18757:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788625378.179597:0:18757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788625378.179601:0:18757:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788625378.179602:0:18757:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625378.179604:0:18757:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625378.179606:0:18757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788625378.179609:0:18757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625378.179610:0:18757:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788625378.179613:0:18757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625378.179616:0:18757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625378.179617:0:18757:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788625378.179620:0:18757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788625378.179622:0:18757:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788625378.179624:0:18757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625378.179627:0:18757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625378.179628:0:18757:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788625378.179630:0:18757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625378.179632:0:18757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625378.179634:0:18757:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788625378.179637:0:18757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788625378.179692:0:18757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625378.179695:0:18757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625378.179697:0:18757:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788625378.179701:0:18757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788625378.180107:0:18740:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788625378.180140:0:18740:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788625378.180167:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b630 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625378.180179:0:18740:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b630 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625378.180188:0:18740:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998743b76800 from 1 10000000:01000000:1.0:1788625378.180191:0:18740:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625378.180234:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7b645 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625378.180242:0:18740:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7b645 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625378.180254:0:18740:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7b645 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625378.180279:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744185180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788625378.180348:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625378.180392:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c64900 going to sleep for 11 seconds 00000100:00100000:0.0:1788625378.186914:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206237952 00000100:00100000:0.0:1788625378.186930:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206237952 00000100:00100000:0.0:1788625378.186998:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788625378.187008:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:18740:x1875509206237952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625378.187028:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625378.187046:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b64c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b645 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625378.187074:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b64c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b645 expref: 20 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625378.187084:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b64c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b645 expref: 20 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625378.187092:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae0200, rc 0) 00000100:00100000:0.0:1788625378.187170:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:18740:x1875509206237952:12345-0@lo:101:mount.lustre.0 Request processed in 163us (6820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625378.187177:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788625378.187587:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744185180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206237952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625378.187609:0:18740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7b645 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b64c expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.187620:0:18740:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7b645 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b64c expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625378.189322:0:18740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788625378.189761:0:18740:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788625378.190609:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788625378.190713:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788625378.190735:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788625378.190740:0:18740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788625378.190821:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744829c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238080:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625378.190907:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625378.190968:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206238080 00000100:00100000:2.0:1788625378.190977:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206238080 00000100:00100000:2.0:1788625378.191107:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788625378.191118:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:18740:x1875509206238080:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625378.191239:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:18740:x1875509206238080:12345-0@lo:501:mount.lustre.0 Request processed in 122us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625378.191245:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743a90780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625378.191249:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788625378.191273:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744829c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238080:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625378.191303:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744829c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238208:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625378.191349:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625378.191375:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743a90780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625378.193274:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206238208 00000100:00100000:2.0:1788625378.193286:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206238208 00000100:00100000:2.0:1788625378.193347:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788625378.193358:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:18740:x1875509206238208:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788625378.193533:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:18740:x1875509206238208:12345-0@lo:503:mount.lustre.0 Request processed in 161us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625378.193543:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788625378.194245:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744829c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238208:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788625378.194944:0:18740:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788625378.195026:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744829c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625378.196715:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625378.196779:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743a90540 going to sleep for 11 seconds 00000100:00100000:2.0:1788625378.197114:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206238336 00000100:00100000:2.0:1788625378.197124:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206238336 00000100:00100000:2.0:1788625378.197176:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788625378.197185:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:18740:x1875509206238336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625378.197339:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:18740:x1875509206238336:12345-0@lo:502:mount.lustre.0 Request processed in 155us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625378.197347:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788625378.199037:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744829c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625378.199897:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788625378.200696:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788625378.200735:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788625378.200751:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788625378.200766:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788625378.200781:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788625378.200795:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788625378.200810:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788625378.200850:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788625378.200866:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788625378.200896:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788625378.202859:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744829c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625378.204732:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625378.204850:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988607fdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625378.206884:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206238464 00000100:00100000:2.0:1788625378.206899:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206238464 00000100:00100000:2.0:1788625378.207050:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788625378.207061:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:18740:x1875509206238464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625378.207259:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:18740:x1875509206238464:12345-0@lo:502:mount.lustre.0 Request processed in 200us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625378.207267:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788625378.207394:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744829c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238464:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625378.207483:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788625378.207504:0:18740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788625378.209591:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625378.209604:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625378.209606:0:18761:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788625378.209621:0:18761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998743b76800 00000020:00000080:1.0:1788625378.209625:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788625378.209642:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625378.209644:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625378.209645:0:18761:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788625378.209648:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625378.209650:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625378.209651:0:18761:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788625378.209654:0:18761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998743b76800 00000020:00000080:1.0:1788625378.209657:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788625378.209719:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625378.209723:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625378.209725:0:18761:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788625378.209728:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625378.209731:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625378.209732:0:18761:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788625378.209735:0:18761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998743b76800 00000020:00000080:1.0:1788625378.209737:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788625378.209756:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625378.209759:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625378.209760:0:18761:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788625378.209762:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625378.209765:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625378.209766:0:18761:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788625378.209770:0:18761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998743b76800 00000020:00000080:1.0:1788625378.209772:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788625378.209795:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625378.209798:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625378.209799:0:18761:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788625378.209802:0:18761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788625378.210831:0:18740:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788625378.210868:0:18740:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625378.210900:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7b645 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b64c expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.210913:0:18740:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7b645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b64c expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625378.210971:0:18740:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788625378.210975:0:18740:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998743b76800 10000000:01000000:2.0:1788625378.210978:0:18740:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998743b76800 10000000:01000000:2.0:1788625378.210983:0:18740:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788625378.210990:0:18740:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998743b76800 from 1 10000000:01000000:2.0:1788625378.210992:0:18740:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788625378.211033:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.211041:0:18740:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.211051:0:18740:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625378.211072:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788625378.211205:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625378.211244:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788625378.211972:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206238592 00000100:00100000:1.0:1788625378.211983:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206238592 00000100:00100000:1.0:1788625378.212055:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788625378.212069:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:18740:x1875509206238592:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625378.212099:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625378.212133:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e5600/0x2d2e3b3f34a7b65a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b653 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625378.212167:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e5600/0x2d2e3b3f34a7b65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b653 expref: 21 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625378.212180:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e5600/0x2d2e3b3f34a7b65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b653 expref: 21 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625378.212190:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5600, rc 0) 00000100:00100000:1.0:1788625378.212268:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:18740:x1875509206238592:12345-0@lo:101:mount.lustre.0 Request processed in 203us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625378.212276:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788625378.213754:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625378.213779:0:18740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b65a expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.213803:0:18740:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b65a expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625378.228964:0:18740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788625378.229322:0:18740:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625378.229855:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788625378.229897:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788625378.229916:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788625378.229992:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788625378.230010:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788625378.230026:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788625378.230040:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788625378.230052:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788625378.230066:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788625378.230757:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788625378.230786:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788625378.230801:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788625378.230815:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788625378.230827:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788625378.230840:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788625378.230853:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788625378.230867:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788625378.230894:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788625378.230909:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788625378.230924:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788625378.230948:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788625378.230963:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788625378.230991:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788625378.231005:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788625378.231019:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788625378.231031:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788625378.231043:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788625378.231056:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788625378.231068:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788625378.231079:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788625378.231104:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788625378.231115:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788625378.231125:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788625378.231136:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788625378.231147:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788625378.231157:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788625378.231168:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788625378.231188:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788625378.231193:0:18740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788625378.231299:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625378.231367:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625378.231419:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bc540 going to sleep for 11 seconds 00000100:00100000:2.0:1788625378.231551:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206238720 00000100:00100000:2.0:1788625378.231559:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206238720 00000100:00100000:1.0:1788625378.240483:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788625378.240512:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:18740:x1875509206238720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788625378.240782:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:18740:x1875509206238720:12345-0@lo:501:mount.lustre.0 Request processed in 285us (9413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625378.240791:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788625378.240821:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625378.240890:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625378.240957:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625378.241010:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206238848 00000100:00100000:3.0:1788625378.241024:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206238848 00000100:00100000:3.0:1788625378.241112:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788625378.241120:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:18740:x1875509206238848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625378.241288:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:18740:x1875509206238848:12345-0@lo:503:mount.lustre.0 Request processed in 169us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625378.241338:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788625378.241399:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bc540 going to sleep for 11 seconds 00000100:00100000:3.0:1788625378.241414:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238848:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788625378.242236:0:18740:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788625378.242310:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625378.242353:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625378.242389:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206238976 00000100:00100000:3.0:1788625378.242393:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206238976 00000100:00100000:3.0:1788625378.242428:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788625378.242435:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:18740:x1875509206238976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625378.242606:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:18740:x1875509206238976:12345-0@lo:502:mount.lustre.0 Request processed in 172us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625378.242681:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788625378.242714:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bc540 going to sleep for 11 seconds 00000100:00100000:3.0:1788625378.242729:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206238976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788625378.242901:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788625378.242928:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788625378.253216:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788625378.253250:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788625378.253268:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788625378.253311:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788625378.253327:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788625378.253339:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788625378.253352:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788625378.253366:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788625378.253380:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788625378.253394:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788625378.253410:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788625378.253428:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788625378.253442:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788625378.256366:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788625378.256410:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788625378.256426:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788625378.256439:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788625378.257703:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788625378.257744:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788625378.257762:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788625378.257777:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788625378.257798:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788625378.257815:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788625378.257831:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788625378.257846:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788625378.257861:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788625378.257903:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788625378.257920:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788625378.260196:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788625378.260290:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788625378.260310:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788625378.260324:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788625378.260335:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788625378.260347:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788625378.260362:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788625378.260375:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788625378.260387:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788625378.260400:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788625378.260415:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788625378.260435:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788625378.261187:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788625378.261226:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788625378.261241:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788625378.261255:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788625378.261271:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788625378.261302:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788625378.261374:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206239104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625378.261477:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625378.261548:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625378.261580:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206239104 00000100:00100000:1.0:1788625378.261590:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206239104 00000100:00100000:1.0:1788625378.261656:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788625378.261666:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:18740:x1875509206239104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625378.261804:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:18740:x1875509206239104:12345-0@lo:502:mount.lustre.0 Request processed in 139us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625378.261814:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788625378.264426:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206239104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788625378.264786:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788625378.264818:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788625378.264860:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206239232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625378.265227:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625378.265274:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788625378.265379:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206239232 00000100:00100000:0.0:1788625378.265387:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206239232 00000100:00100000:0.0:1788625378.265460:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788625378.265471:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:18740:x1875509206239232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625378.265646:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:18740:x1875509206239232:12345-0@lo:502:mount.lustre.0 Request processed in 176us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625378.265656:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788625378.265997:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206239232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788625378.266059:0:18740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788625378.266070:0:18740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788625378.267598:0:18767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788625378.267708:0:18767:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9988442399c0) 00000020:00000080:2.0:1788625378.267733:0:18767:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788625378.267860:0:18767:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998743b76800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788625378.267865:0:18767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998743b76800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788625378.267878:0:18767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998743b76800 3 00010000:00080000:2.0:1788625378.267912:0:18767:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998742cf4000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.114@tcp at head 00010000:00010000:2.0:1788625378.271341:0:18767:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788625378.271676:0:18767:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788625378.271733:0:18767:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788625378.271760:0:18767:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2d2e3b3f34a7b668 00000100:00080000:2.0:1788625378.271776:0:18767:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625378.271783:0:18767:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff998742cf4000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625378.271830:0:18767:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874427c380 x1875509206239360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625378.272112:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206239360:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788625378.272188:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625378.272269:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206239360 00000100:00100000:3.0:1788625378.272278:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206239360 00000100:00100000:3.0:1788625378.272313:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788625378.272322:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875509206239360:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788625378.272349:0:17240:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:3.0:1788625378.272398:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2d2e3b3f34a7b66f 00000004:00100000:3.0:1788625378.272420:0:17240:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788625378.272465:0:17240:0:(import.c:65:import_set_state_nolock()) ffff99887ca90800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625378.272535:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875509206239360:12345-0@lo:38:llog_process_th.0 Request processed in 196us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625378.272543:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788625378.272601:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99874427c380 x1875509206239360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625378.272625:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788625378.272634:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788625378.272643:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788625378.272647:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788625378.272650:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998742cf4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788625378.272657:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206239360:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788625378.272905:0:18767:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788625378.273339:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625378.273344:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625378.273346:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625378.273349:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625378.273373:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625378.273377:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625378.273380:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625378.273383:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788625378.273412:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206239872:0@lo:400:kworker.0 00000100:00100000:3.0:1788625378.273460:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625378.273499:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625378.273506:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206239488:0@lo:400:kworker.0 00000100:00100000:3.0:1788625378.273567:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625378.273601:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206239488 00000100:00100000:3.0:1788625378.273609:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206239616:0@lo:400:kworker.0 00000100:00100000:1.0:1788625378.273609:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206239488 00000100:00100000:1.0:1788625378.273651:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788625378.273665:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625378.273671:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206239488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625378.273691:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625378.273699:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206239744:0@lo:400:kworker.0 00000100:00100000:3.0:1788625378.273733:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625378.273735:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206239488:12345-0@lo:400:kworker.0 Request processed in 65us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625378.273745:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788625378.273763:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206239744 00000100:00100000:1.0:1788625378.273766:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206239744 00000100:00100000:1.0:1788625378.273787:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788625378.273792:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206239872 00000100:00100000:1.0:1788625378.273796:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206239744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625378.273799:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206239872 00000100:00100000:3.0:1788625378.273832:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206239616 00000100:00100000:3.0:1788625378.273836:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206239616 00000100:00100000:1.0:1788625378.273843:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206239744:12345-0@lo:400:kworker.0 Request processed in 49us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625378.273850:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788625378.273859:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625378.273878:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206239872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625378.273894:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625378.273904:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206239616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625378.273921:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206239872:12345-0@lo:400:kworker.0 Request processed in 53us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625378.273929:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788625378.273944:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206239616:12345-0@lo:400:kworker.0 Request processed in 42us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625378.273951:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625378.273985:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206239744:0@lo:400:kworker.0 00010000:00080000:1.0:1788625378.273998:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9987442d5f80 x1875509206239616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625378.274084:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206239616:0@lo:400:kworker.0 00000100:00100000:1.0:1788625378.274115:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206239488:0@lo:400:kworker.0 00010000:00080000:1.0:1788625378.274125:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9987442d5880 x1875509206239872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625378.274133:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206239872:0@lo:400:kworker.0 00000020:01000004:3.0:1788625378.277337:0:18767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788625378.277355:0:18767:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff998742ed4d40) 00000020:00000080:3.0:1788625378.277380:0:18767:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788625378.277698:0:18767:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998743b76800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788625378.277703:0:18767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998743b76800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788625378.277706:0:18767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998743b76800 3 00010000:00080000:3.0:1788625378.277737:0:18767:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998742cf4800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.114@tcp at head 00010000:00010000:3.0:1788625378.287284:0:18767:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788625378.287511:0:18767:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788625378.287592:0:18767:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788625378.287606:0:18767:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2d2e3b3f34a7b67d 00000100:00080000:3.0:1788625378.287628:0:18767:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788625378.287646:0:18767:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff998742cf4800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625378.290756:0:18767:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9987442d5500 x1875509206240000/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625378.290807:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875509206240000:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788625378.290915:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788625378.290983:0:18767:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788625378.291006:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625378.291010:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625378.291013:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625378.291016:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625378.291019:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625378.291022:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625378.291024:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625378.291027:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788625378.291184:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206240000 00000100:00100000:1.0:1788625378.291192:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206240000 00000100:00100000:1.0:1788625378.291237:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788625378.291245:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875509206240000:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788625378.291276:0:17241:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:1.0:1788625378.291314:0:17241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2d2e3b3f34a7b684 00000004:00100000:1.0:1788625378.291330:0:17241:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788625378.291365:0:17241:0:(import.c:65:import_set_state_nolock()) ffff99887b6f6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625378.291423:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875509206240000:12345-0@lo:38:llog_process_th.0 Request processed in 178us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625378.291430:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788625378.291475:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9987442d5500 x1875509206240000/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625378.291486:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788625378.291493:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788625378.291500:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788625378.291505:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788625378.291507:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998742cf4800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788625378.291512:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875509206240000:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788625378.292990:0:18767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788625378.293043:0:18740:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788625378.293072:0:18740:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788625378.293089:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b65a expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.293101:0:18740:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b65a expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788625378.293153:0:18740:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788625378.293159:0:18740:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788625378.293160:0:18740:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625378.293161:0:18740:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625378.293162:0:18740:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625378.293163:0:18740:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625378.293164:0:18740:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625378.293166:0:18740:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625378.293167:0:18740:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788625378.293171:0:18740:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788625378.293173:0:18740:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788625378.293174:0:18740:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788625378.293175:0:18740:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625378.293176:0:18740:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625378.293177:0:18740:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625378.293178:0:18740:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625378.293178:0:18740:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625378.293179:0:18740:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625378.293180:0:18740:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788625378.293206:0:18740:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788625378.293224:0:18740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206240128:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788625378.293285:0:18740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625378.293330:0:18740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625378.293762:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206240128 00000100:00100000:3.0:1788625378.293770:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206240128 00000100:00100000:3.0:1788625378.293817:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788625378.293827:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:18740:x1875509206240128:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788625378.293854:0:17232:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788625378.293881:0:17232:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788625378.300889:0:17232:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788625378.300908:0:17232:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788625378.301076:0:17255:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788625378.301083:0:17255:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788625378.301106:0:17255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b68b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.301127:0:17255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998743ae0800/0x2d2e3b3f34a7b5d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b5ce expref: 21 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.301134:0:17255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b5e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b5dc expref: 21 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.301156:0:17255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b68b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625378.301189:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:18740:x1875509206240128:12345-0@lo:253:mount.lustre.0 Request processed in 7361us (7902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625378.301201:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788625378.301312:0:18740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:18740:1875509206240128:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788625378.301326:0:18740:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788625378.301329:0:18740:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788625378.301331:0:18740:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788625378.301332:0:18740:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625378.301333:0:18740:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625378.301335:0:18740:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625378.301336:0:18740:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625378.301337:0:18740:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788625378.301339:0:18740:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625378.301340:0:18740:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788625378.301357:0:18740:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788625378.301432:0:17255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5dc expref: 20 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.301446:0:17255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b5e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5dc expref: 20 pid: 17232 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625378.301460:0:17255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17255:1875509206240256:0@lo:104: 00000100:00100000:2.0:1788625378.301494:0:17255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625378.301570:0:17255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998743ae0800/0x2d2e3b3f34a7b5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5ce expref: 20 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.301578:0:17255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998743ae0800/0x2d2e3b3f34a7b5d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5ce expref: 20 pid: 17233 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625378.301586:0:17255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17255:1875509206240384:0@lo:104: 00000100:00100000:2.0:1788625378.301610:0:17255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625378.301626:0:17255:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788625378.301763:0:17222:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788625378.301781:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206240256 00000100:00100000:3.0:1788625378.301793:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206240256 00000100:00100000:3.0:1788625378.301819:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206240384 00000100:00100000:3.0:1788625378.301822:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206240384 00000100:00100000:3.0:1788625378.301834:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625378.301841:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+4:17255:x1875509206240256:12345-0@lo:104: 00010000:00010000:3.0:1788625378.301853:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b5e3 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.301920:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625378.301926:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+4:17255:x1875509206240256:12345-0@lo:104: Request processed in 85us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625378.301932:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625378.301945:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625378.301951:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+3:17255:x1875509206240384:12345-0@lo:104: 00010000:00010000:3.0:1788625378.301958:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff9988412e5800/0x2d2e3b3f34a7b5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b5d5 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.301990:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788625378.301996:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+3:17255:x1875509206240384:12345-0@lo:104: Request processed in 46us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625378.302001:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788625378.302016:0:17255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17255:1875509206240256:0@lo:104: 00000100:00100000:2.0:1788625378.302024:0:17255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17255:1875509206240384:0@lo:104: 00010000:00010000:3.0:1788625378.302035:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625378.302039:0:17255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b68b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.302041:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b5e3 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.302048:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9200 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625378.302051:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7b5e3 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.302071:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7b5e3 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625378.302078:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7b5e3 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625378.302083:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788625378.302114:0:17227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b5dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b5e3 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.302120:0:17227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625378.302142:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b5dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b5e3 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.302149:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b5dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b5e3 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.302161:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625378.302164:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff9988412e5800/0x2d2e3b3f34a7b5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b5d5 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.302169:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625378.302172:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff9988412e5800/0x2d2e3b3f34a7b5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7b5d5 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.302177:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff9988412e5800/0x2d2e3b3f34a7b5ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7b5d5 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625378.302183:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff9988412e5800/0x2d2e3b3f34a7b5ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7b5d5 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625378.302195:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788625378.302210:0:17227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff9988412e5800/0x2d2e3b3f34a7b5ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b5d5 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.302214:0:17227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625378.302231:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff9988412e5800/0x2d2e3b3f34a7b5ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b5d5 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.302238:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff9988412e5800/0x2d2e3b3f34a7b5ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b5d5 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.302252:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625378.302254:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625378.302256:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625378.302263:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625378.302274:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3636:1875509206240512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625378.302304:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625378.302342:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206240640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625378.302364:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625378.302416:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206240512 00000100:00100000:3.0:1788625378.302420:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206240512 00010000:00010000:3.0:1788625378.302436:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b5e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5dc expref: 21 pid: 17232 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625378.302479:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206240640 00000100:00100000:3.0:1788625378.302483:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206240640 00010000:00010000:3.0:1788625378.302494:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998743ae0800/0x2d2e3b3f34a7b5d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5ce expref: 22 pid: 17233 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625378.302532:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625378.302536:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788625378.302540:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:3636:x1875509206240512:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625378.302541:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872679450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:3637:x1875509206240640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625378.302552:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625378.302553:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625378.302556:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998743ae0800/0x2d2e3b3f34a7b5d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5ce expref: 22 pid: 17233 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.302557:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b5e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5dc expref: 22 pid: 17232 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.302566:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998743ae0800/0x2d2e3b3f34a7b5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5ce expref: 22 pid: 17233 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.304060:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5dc expref: 22 pid: 17232 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.304085:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743ae0800/0x2d2e3b3f34a7b5d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5ce expref: 22 pid: 17233 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.304086:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b5e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5dc expref: 22 pid: 17232 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.304103:0:17226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b68b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.304113:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b68b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625378.304123:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 20000000:01000000:3.0:1788625378.304132:0:17226:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004648846s 00010000:00010000:3.0:1788625378.304156:0:17226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b68b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.304163:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b68b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.304169:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b68b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.304175:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b68b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.304190:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625378.304194:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b68b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.304203:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b68b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625378.304334:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:3636:x1875509206240512:12345-0@lo:103:ldlm_bl.0 Request processed in 1793us (2027us total) trans 0 rc 0/0 00010000:00010000:1.0:1788625378.304335:0:17255:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b68b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625378.304345:0:17255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b68b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625378.304404:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3636:1875509206240512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625378.304421:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788625378.304600:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b68b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.304671:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b68b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625378.304689:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625378.304763:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872679450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:3637:x1875509206240640:12345-0@lo:103:ldlm_bl.0 Request processed in 2221us (2398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625378.304772:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625378.304917:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206240640:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1788625378.306175:0:18740:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788625378.309260:0:18740:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788625378.309273:0:18740:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788625378.309322:0:18740:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788625378.309377:0:18740:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788625378.309416:0:18740:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788625378.309441:0:18740:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788625378.310475:0:18740:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788625378.310745:0:18740:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788625378.700500:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788625379.097988:0:18821:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625379.098215:0:18821:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788625379.597133:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625379.597161:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744186a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206240768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625379.597236:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625379.599082:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206240768 00000100:00100000:1.0:1788625379.599100:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206240768 00000100:00100000:1.0:1788625379.599169:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788625379.599180:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206240768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625379.599220:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788625379.599316:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206240768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625379.599324:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788625379.599694:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744186a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206240768:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788625379.727260:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625380.109157:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206240896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788625380.109260:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625380.112880:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206240896 00000100:00100000:2.0:1788625380.112899:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206240896 00000100:00100000:2.0:1788625380.112988:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788625380.113000:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206240896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788625380.113044:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788625380.113166:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206240896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (3908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625380.113174:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788625380.113236:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206240896:0@lo:41:osp-pre-1-0.0 10000000:01000000:3.0:1788625380.301391:0:17236:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788625380.301402:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9987427c7800 from 9 10000000:01000000:3.0:1788625380.301408:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788625380.301475:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625380.301497:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625380.301511:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625380.301742:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206241024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625380.301837:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625380.301933:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206241024 00000100:00100000:0.0:1788625380.301944:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206241024 00000100:00100000:0.0:1788625380.302012:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788625380.302024:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:17236:x1875509206241024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625380.302042:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625380.302059:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743ae0e00/0x2d2e3b3f34a7b699 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b692 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625380.302091:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743ae0e00/0x2d2e3b3f34a7b699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b692 expref: 20 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625380.302104:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743ae0e00/0x2d2e3b3f34a7b699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b692 expref: 20 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625380.302116:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743ae0e00, rc 0) 00000100:00100000:0.0:1788625380.302159:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:17236:x1875509206241024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625380.302165:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788625380.302631:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff99874272cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788625380.302662:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206241024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625380.302681:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b699 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625380.302693:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b699 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625380.302757:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206241152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788625380.302795:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625380.302826:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff99874272cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625380.303038:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206241152 00000100:00100000:0.0:1788625380.303043:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206241152 00000100:00100000:0.0:1788625380.303079:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788625380.303085:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:17236:x1875509206241152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788625380.303103:0:17232:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788625380.303120:0:17232:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788625380.303124:0:17232:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788625380.303210:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:17236:x1875509206241152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625380.303217:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788625380.303256:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206241152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788625380.303322:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788625380.303331:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b699 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625380.303350:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b699 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625380.303473:0:17236:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788625380.303476:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998848aae000 from 9 10000000:01000000:0.0:1788625380.303479:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788625380.303502:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae0400/0x2d2e3b3f34a7b6a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625380.303511:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998743ae0400/0x2d2e3b3f34a7b6a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625380.303545:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998743ae0400/0x2d2e3b3f34a7b6a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625380.303572:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206241280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625380.303601:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625380.303627:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887266b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625380.304418:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206241280 00000100:00100000:3.0:1788625380.304425:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206241280 00000100:00100000:3.0:1788625380.304463:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788625380.304471:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:17236:x1875509206241280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625380.304483:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625380.304499:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998859be8c00/0x2d2e3b3f34a7b6a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b6a0 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625380.304638:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998859be8c00/0x2d2e3b3f34a7b6a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b6a0 expref: 21 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625380.304650:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998859be8c00/0x2d2e3b3f34a7b6a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b6a0 expref: 21 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625380.304662:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be8c00, rc 0) 00000100:00100000:3.0:1788625380.307748:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:17236:x1875509206241280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3265us (4133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625380.307766:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788625380.308325:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206241280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625380.308360:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998743ae0400/0x2d2e3b3f34a7b6a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b6a7 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625380.308376:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998743ae0400/0x2d2e3b3f34a7b6a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b6a7 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625380.308473:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206241408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788625380.308764:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625380.308808:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887266b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625380.308977:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206241408 00000100:00100000:3.0:1788625380.308985:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206241408 00000100:00100000:3.0:1788625380.309026:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788625380.309034:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:17236:x1875509206241408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788625380.309055:0:17234:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788625380.309071:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788625380.309074:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788625380.309157:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:17236:x1875509206241408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625380.309164:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788625380.332133:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206241408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788625380.332273:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788625380.332797:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae0400/0x2d2e3b3f34a7b6a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b6a7 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625380.332810:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998743ae0400/0x2d2e3b3f34a7b6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b6a7 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625380.747715:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625381.774478:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625382.799456:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788625383.691745:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625383.691753:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625383.691756:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625383.691767:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625383.691799:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625383.691802:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625383.691805:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625383.691808:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788625383.691851:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206241920:0@lo:400:kworker.0 00000100:00100000:3.0:1788625383.691938:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625383.691939:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3636:1875509206241536:0@lo:400:kworker.0 00000100:00100000:2.0:1788625383.692000:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625383.692006:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206241664:0@lo:400:kworker.0 00000100:00100000:3.0:1788625383.692039:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625383.692044:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206242048:0@lo:400:kworker.0 00000100:00100000:3.0:1788625383.692063:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206242176:0@lo:400:kworker.0 00000100:00100000:0.0:1788625383.692067:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206241920 00000100:00100000:0.0:1788625383.692077:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206241920 00000100:00100000:3.0:1788625383.692095:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625383.692108:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206241792:0@lo:400:kworker.0 00000100:00100000:3.0:1788625383.692139:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206241664 00000100:00100000:2.0:1788625383.692139:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625383.692145:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206241664 00000100:00100000:2.0:1788625383.692165:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206242304:0@lo:400:kworker.0 00000100:00100000:3.0:1788625383.692186:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625383.692196:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625383.692200:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206241920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625383.692233:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206241536 00000100:00100000:2.0:1788625383.692238:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206241536 00000100:00100000:3.0:1788625383.692270:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206241920:12345-0@lo:400:kworker.0 Request processed in 74us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625383.692282:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788625383.692291:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:3636:x1875509206241536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625383.692300:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788625383.692307:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206241664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625383.692324:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:3636:x1875509206241536:12345-0@lo:400:kworker.0 Request processed in 35us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625383.692331:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788625383.692346:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206241664:12345-0@lo:400:kworker.0 Request processed in 41us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625383.692353:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788625383.692631:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788625383.692659:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206242176 00000100:00100000:3.0:1788625383.692663:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206242176 00000100:00100000:2.0:1788625383.692694:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206241792 00000100:00100000:2.0:1788625383.692700:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206241792 00000100:00100000:3.0:1788625383.692708:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206242304 00000100:00100000:3.0:1788625383.692714:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206242304 00000100:00100000:2.0:1788625383.692727:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625383.692736:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206242176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625383.692742:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788625383.692751:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206241792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625383.692786:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206242176:12345-0@lo:400:kworker.0 Request processed in 52us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625383.692792:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625383.692804:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788625383.692816:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206242304:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788625383.692952:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788625383.692957:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625383.693162:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206242304:12345-0@lo:400:kworker.0 Request processed in 345us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625383.693169:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788625383.693203:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625383.693240:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3636:1875509206241536:0@lo:400:kworker.0 00000100:00100000:2.0:1788625383.693265:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206242048 00000100:00100000:2.0:1788625383.693268:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206242048 00010000:00080000:0.0:1788625383.693284:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9987442d5c00 x1875509206242304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625383.693289:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625383.693294:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206242048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625383.693298:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206242304:0@lo:400:kworker.0 00000100:00100000:2.0:1788625383.693326:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206242048:12345-0@lo:400:kworker.0 Request processed in 31us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625383.693332:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788625383.693336:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9987442d5500 x1875509206242048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625383.693346:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206242048:0@lo:400:kworker.0 00000100:00100000:2.0:1788625383.693606:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206241664:0@lo:400:kworker.0 00010000:00080000:2.0:1788625383.693622:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9987442d6680 x1875509206242176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625383.693631:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206242176:0@lo:400:kworker.0 00000100:00100000:2.0:1788625383.693657:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206241920:0@lo:400:kworker.0 00000100:00100000:3.0:1788625383.695771:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206241792:12345-0@lo:400:kworker.0 Request processed in 3001us (3611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625383.695798:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788625383.696308:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9987442d5f80 x1875509206241792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625383.696324:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206241792:0@lo:400:kworker.0 00010000:00010000:3.0:1788625383.820657:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625384.269445:0:17273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1788625384.298900:0:19110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788625384.716376:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206242432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625384.716459:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625384.716640:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206242432 00000100:00100000:0.0:1788625384.716663:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206242432 00000100:00100000:0.0:1788625384.716719:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788625384.716728:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206242432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788625384.716772:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788625384.716960:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206242432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 232us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625384.716968:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788625384.717036:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206242432:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788625384.846040:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788625385.164047:0:19162:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625385.165249:0:19162:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788625385.228880:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625385.228904:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206242560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625385.228980:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625385.229041:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206242560 00000100:00100000:1.0:1788625385.229050:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206242560 00000100:00100000:1.0:1788625385.229104:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788625385.229114:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206242560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788625385.229155:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788625385.229211:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206242560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625385.229219:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788625385.229263:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206242560:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788625385.876126:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788625386.063459:0:19212:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788625386.064238:0:19212:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788625386.893215:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625387.020242:0:17997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788625387.916052:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788625388.821967:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625388.821974:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625388.821977:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625388.821979:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625388.822001:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625388.822005:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625388.822007:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625388.822010:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788625388.822044:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206242944:0@lo:400:kworker.0 00000100:00100000:2.0:1788625388.822219:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206242688:0@lo:400:kworker.0 00000100:00100000:1.0:1788625388.822281:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206242816:0@lo:400:kworker.0 00000100:00100000:3.0:1788625388.824806:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206243072:0@lo:400:kworker.0 00000100:00100000:2.0:1788625388.824935:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625388.824984:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206243200:0@lo:400:kworker.0 00000100:00100000:2.0:1788625388.825011:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625388.825054:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206242688 00000100:00100000:2.0:1788625388.825061:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206242688 00000100:00100000:2.0:1788625388.825117:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788625388.825127:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:3637:x1875509206242688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625388.825179:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:3637:x1875509206242688:12345-0@lo:400:kworker.0 Request processed in 53us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625388.825187:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788625388.825407:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206243200 00000100:00100000:2.0:1788625388.825411:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206243200 00000100:00100000:2.0:1788625388.825439:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788625388.825445:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206243200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625388.825478:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206243200:12345-0@lo:400:kworker.0 Request processed in 33us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625388.825485:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788625388.825537:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206242688:0@lo:400:kworker.0 00010000:00080000:2.0:1788625388.825553:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99874482b100 x1875509206243200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625388.825565:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206243200:0@lo:400:kworker.0 00000100:00100000:0.0:1788625388.825916:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625388.825951:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206243456:0@lo:400:kworker.0 00000100:00100000:0.0:1788625388.825978:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625388.826008:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206242944 00000100:00100000:0.0:1788625388.826013:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206242944 00000100:00100000:0.0:1788625388.826033:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206243456 00000100:00100000:0.0:1788625388.826035:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206243456 00000100:00100000:0.0:1788625388.826078:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625388.826099:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206242944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625388.826136:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206242944:12345-0@lo:400:kworker.0 Request processed in 39us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625388.826143:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625388.826155:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788625388.826161:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206243456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625388.826187:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206243456:12345-0@lo:400:kworker.0 Request processed in 26us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625388.826207:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788625388.826223:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788625388.826243:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998744828700 x1875509206242944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625388.826253:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206242944:0@lo:400:kworker.0 00010000:00080000:0.0:1788625388.826262:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998744828000 x1875509206243456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625388.826270:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206243456:0@lo:400:kworker.0 00000100:00100000:1.0:1788625388.826848:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625388.826881:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206243328:0@lo:400:kworker.0 00000100:00100000:1.0:1788625388.826911:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625388.826942:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206243328 00000100:00100000:1.0:1788625388.826958:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206243328 00000100:00100000:1.0:1788625388.826994:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788625388.827001:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206243328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625388.827040:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206243328:12345-0@lo:400:kworker.0 Request processed in 40us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625388.827046:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788625388.827062:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788625388.828542:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998744829500 x1875509206243328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625388.828561:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206243328:0@lo:400:kworker.0 00000100:00100000:0.0:1788625388.829282:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206242816 00000100:00100000:0.0:1788625388.829291:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206242816 00000100:00100000:0.0:1788625388.829393:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788625388.829403:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206242816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625388.829493:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206242816:12345-0@lo:400:kworker.0 Request processed in 92us (2646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625388.829501:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788625388.829778:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625388.829842:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206242816:0@lo:400:kworker.0 00000100:00100000:1.0:1788625388.832632:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206243072 00000100:00100000:1.0:1788625388.832650:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206243072 00000100:00100000:1.0:1788625388.832738:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788625388.832748:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206243072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625388.832846:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206243072:12345-0@lo:400:kworker.0 Request processed in 99us (3068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625388.832854:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788625388.833057:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206243072:0@lo:400:kworker.0 00010000:00010000:0.0:1788625388.943422:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625389.579933:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625374/real 1788625374] req@ffff998744184380 x1875509206235904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625389 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625389.579972:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998744184380 x1875509206235904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625389 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625389.579982:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625374/real 1788625374] req@ffff998744184000 x1875509206236032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625389 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625389.579994:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998744184000 x1875509206236032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625389 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788625389.580018:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b64e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625389.580044:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788625389.580048:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206235904:0@lo:8:kworker.0 00000100:00080000:3.0:1788625389.580054:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998854e39000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625389.580059:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788625389.580062:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206236032:0@lo:8:kworker.0 00000100:00100000:0.0:1788625389.580815:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1788625389.582620:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625389.582627:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625389.582631:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625389.582634:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788625389.582746:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206243712:0@lo:400:kworker.0 00000100:00100000:3.0:1788625389.582830:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625389.582884:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625389.582890:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206243840:0@lo:400:kworker.0 00000100:00100000:3.0:1788625389.582920:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625389.582965:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206243712 00000100:00100000:3.0:1788625389.582974:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206243712 00000100:00100000:3.0:1788625389.583032:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788625389.583042:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206243712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625389.583101:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206243712:12345-0@lo:400:kworker.0 Request processed in 61us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625389.583109:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788625389.583137:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206243840 00000100:00100000:3.0:1788625389.583142:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206243840 00000100:00100000:3.0:1788625389.583172:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788625389.583179:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206243840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625389.583212:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206243840:12345-0@lo:400:kworker.0 Request processed in 34us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625389.583219:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788625389.583266:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99874427fb80 x1875509206243840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625389.583284:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206243840:0@lo:400:kworker.0 00000100:00100000:3.0:1788625389.583296:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206243712:0@lo:400:kworker.0 00000100:00100000:0.0:1788625389.585930:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206243968:0@lo:400:kworker.0 00000100:00100000:0.0:1788625389.586010:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625389.586104:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206243584:0@lo:400:kworker.0 00000100:00100000:0.0:1788625389.586139:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625389.586206:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206243584 00000100:00100000:0.0:1788625389.586292:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206243584 00000100:00100000:0.0:1788625389.586351:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788625389.586361:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:3635:x1875509206243584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625389.586415:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:3635:x1875509206243584:12345-0@lo:400:kworker.0 Request processed in 56us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625389.586421:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788625389.586479:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206243584:0@lo:400:kworker.0 00000100:00100000:1.0:1788625389.586793:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206243968 00000100:00100000:1.0:1788625389.586798:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206243968 00000100:00100000:1.0:1788625389.586883:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788625389.586891:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206243968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625389.586938:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206243968:12345-0@lo:400:kworker.0 Request processed in 49us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625389.586945:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788625389.587022:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206243968:0@lo:400:kworker.0 00000100:00080000:2.0:1788625389.588231:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625389.588240:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788625389.588245:0:37:0:(import.c:65:import_set_state_nolock()) ffff99887b64e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788625389.588252:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 496 00000100:00080000:2.0:1788625389.588259:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788625389.588265:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99887b64e800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625389.588303:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874427ea00 x1875509206244096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788625389.588364:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206244096:0@lo:8:kworker.0 00000100:00100000:1.0:1788625389.588441:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788625389.588577:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625389.588582:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788625389.588584:0:37:0:(import.c:65:import_set_state_nolock()) ffff998854e39000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788625389.588588:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 496 00000100:00080000:2.0:1788625389.588590:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788625389.588595:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998854e39000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625389.588611:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874427d880 x1875509206244224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625389.588681:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206244096 00000100:00100000:0.0:1788625389.588688:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206244096 00000100:00100000:0.0:1788625389.588720:0:18745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625389.588727:0:18745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875509206244096:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788625389.588759:0:18745:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1788625389.589029:0:18745:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7b6ae 00002000:00100000:0.0:1788625389.589045:0:18745:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9987427a3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788625389.589051:0:18745:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788625389.589054:0:18745:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788625389.589251:0:18745:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788625389.589278:0:18745:0:(import.c:65:import_set_state_nolock()) ffff9987427a7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625389.589351:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206244224:0@lo:8:kworker.0 00000100:00100000:1.0:1788625389.589382:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625389.589547:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206244608:0@lo:400:kworker.0 00000100:00100000:2.0:1788625389.589580:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625389.589605:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625389.589626:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206244480:0@lo:400:kworker.0 00000100:00100000:2.0:1788625389.589663:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625389.589694:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206244608 00000100:00100000:2.0:1788625389.589699:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206244608 00000100:00100000:2.0:1788625389.589734:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206244480 00000100:00100000:2.0:1788625389.589737:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206244480 00000100:00100000:2.0:1788625389.589757:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625389.589764:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206244608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625389.589816:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206244608:12345-0@lo:400:kworker.0 Request processed in 53us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625389.589824:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625389.589844:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788625389.589850:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206244480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625389.589875:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206244480:12345-0@lo:400:kworker.0 Request processed in 26us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625389.589881:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788625389.589938:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99874427c000 x1875509206244480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625389.589951:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206244480:0@lo:400:kworker.0 00010000:00080000:2.0:1788625389.589960:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99874427c700 x1875509206244608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625389.589968:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206244608:0@lo:400:kworker.0 00000100:00100000:0.0:1788625389.590590:0:18745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1875509206244096:12345-0@lo:8:kworker.0 Request processed in 1860us (2146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625389.590612:0:18745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625389.590628:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206244224 00000100:00100000:0.0:1788625389.590633:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206244224 00010000:00080000:1.0:1788625389.591658:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99874427ea00 x1875509206244096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625389.591671:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788625389.591680:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788625389.591688:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788625389.591693:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788625389.591697:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b64e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788625389.591718:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788625389.591724:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206244096:0@lo:8:kworker.0 00000004:00080000:1.0:1788625389.591770:0:17979:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788625389.591865:0:17979:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 510699347439ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788625389.591872:0:17979:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788625389.591894:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625389.591917:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206244352:0@lo:400:kworker.0 00000100:00100000:1.0:1788625389.591975:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788625389.593071:0:17980:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788625389.593100:0:17980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17980:1875509206244864:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788625389.593162:0:17980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625389.593198:0:17980:0:(client.c:2716:ptlrpc_set_wait()) set ffff998878108240 going to sleep for 11 seconds 00000100:00100000:2.0:1788625389.593387:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206244352 00000100:00100000:2.0:1788625389.593396:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206244352 00000100:00100000:2.0:1788625389.593448:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788625389.593457:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206244352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625389.593506:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206244352:12345-0@lo:400:kworker.0 Request processed in 50us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625389.593547:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788625389.593998:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625389.594006:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206244864 00000100:00100000:0.0:1788625389.594013:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206244864 00000100:00100000:3.0:1788625389.594015:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206244736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625389.594054:0:18745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788625389.594061:0:18745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875509206244224:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788625389.594072:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:0.0:1788625389.594083:0:18745:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788625389.594121:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206244736 00000100:00100000:3.0:1788625389.594125:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206244736 00000100:00100000:3.0:1788625389.594150:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625389.594158:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3636:x1875509206244736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788625389.594182:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788625389.594221:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3636:x1875509206244736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625389.594228:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788625389.594264:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99874427c700 x1875509206244736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625389.594944:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206244736:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788625389.595300:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788625389.595346:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99874427e680 x1875509206244352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625389.595357:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206244352:0@lo:400:kworker.0 00000004:00080000:1.0:1788625389.605788:0:17970:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788625389.608956:0:18745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875509206244224:12345-0@lo:8:kworker.0 Request processed in 14885us (19563us total) trans 0 rc -19/-19 00000100:00080000:1.0:1788625389.609092:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998854e39000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788625389.609099:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788625389.609103:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206244224:0@lo:8:kworker.0 00000100:00100000:0.0:1788625389.609170:0:18745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788625389.609207:0:18745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625389.609219:0:18745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17980:x1875509206244864:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1788625389.613426:0:18745:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788625389.613434:0:18745:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788625389.613602:0:18745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17980:x1875509206244864:12345-0@lo:7:osp-pre-0-1.0 Request processed in 4383us (20436us total) trans 0 rc 0/0 00010000:00080000:2.0:1788625389.613608:0:17980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99874427c000 x1875509206244864/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788625405 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625389.613618:0:18745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625389.613631:0:17980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17980:1875509206244864:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788625389.613659:0:17980:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788625389.613710:0:17980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17980:1875509206244992:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788625389.613751:0:17980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625389.614191:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206244992 00000100:00100000:2.0:1788625389.614192:0:17980:0:(client.c:2716:ptlrpc_set_wait()) set ffff998878108240 going to sleep for 11 seconds 00000100:00100000:3.0:1788625389.614200:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206244992 00000100:00100000:3.0:1788625389.614273:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788625389.614282:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17980:x1875509206244992:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788625389.614308:0:18747:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788625389.614359:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17980:x1875509206244992:12345-0@lo:5:osp-pre-0-1.0 Request processed in 79us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625389.614366:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788625389.614472:0:17980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99874427c000 x1875509206244992/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625405 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625389.614484:0:17980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17980:1875509206244992:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788625389.614494:0:17980:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788625389.614561:0:17980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17980:1875509206245120:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788625389.614590:0:17980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625389.614676:0:17980:0:(client.c:2716:ptlrpc_set_wait()) set ffff998878108240 going to sleep for 11 seconds 00000100:00100000:0.0:1788625389.620242:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206245120 00000100:00100000:0.0:1788625389.620260:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206245120 00000100:00100000:0.0:1788625389.620326:0:18745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625389.620339:0:18745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17980:x1875509206245120:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788625389.620393:0:18745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:3.0:1788625389.636448:0:18741:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788625389.636469:0:18741:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788625389.637011:0:18745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17980:x1875509206245120:12345-0@lo:5:osp-pre-0-1.0 Request processed in 16667us (22412us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788625389.637029:0:18745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788625389.637173:0:17980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99874427c000 x1875509206245120/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625405 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625389.637189:0:17980:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788625389.637214:0:17980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17980:1875509206245120:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788625389.637232:0:17980:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788625389.637297:0:17980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17980:1875509206245248:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788625389.637417:0:17980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625389.637483:0:17980:0:(client.c:2716:ptlrpc_set_wait()) set ffff998878108240 going to sleep for 11 seconds 00000100:00100000:1.0:1788625389.637667:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206245248 00000100:00100000:1.0:1788625389.637676:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206245248 00000100:00100000:1.0:1788625389.637771:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788625389.637782:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17980:x1875509206245248:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788625389.637843:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17980:x1875509206245248:12345-0@lo:900:osp-pre-0-1.0 Request processed in 64us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625389.637850:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788625389.637906:0:17980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99874427c000 x1875509206245248/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788625405 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625389.637917:0:17980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17980:1875509206245248:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788625389.835676:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206245376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625389.835764:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625389.835822:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206245376 00000100:00100000:2.0:1788625389.835830:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206245376 00000100:00100000:2.0:1788625389.835877:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625389.835886:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206245376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788625389.835921:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788625389.835972:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206245376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625389.835979:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625389.836031:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874427c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206245376:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788625389.966512:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625390.347780:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625390.347815:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206245504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625390.347895:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625390.348216:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206245504 00000100:00100000:1.0:1788625390.348226:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206245504 00000100:00100000:1.0:1788625390.348290:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788625390.348302:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206245504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788625390.348347:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788625390.348410:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206245504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625390.348418:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788625390.348473:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206245504:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788625390.988277:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625392.013155:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788625392.878038:0:19557:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788625392.878043:0:19557:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788625392.878051:0:19557:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788625392.878262:0:19557:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9987427a5000 00000020:01000004:0.0:1788625392.878284:0:19557:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788625392.878301:0:19557:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788625392.878318:0:19557:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99887cb199c0) 00000020:00000080:0.0:1788625392.878340:0:19557:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788625392.928010:0:19557:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788625392.931853:0:19557:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788625392.932296:0:19557:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788625392.932508:0:19557:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788625392.933201:0:19557:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788625392.933418:0:19557:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788625392.933713:0:19557:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:0.0:1788625392.935208:0:19557:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788625392.935502:0:19557:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788625392.935775:0:19557:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788625392.935790:0:19557:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2d2e3b3f34a7b6bc 00000020:01000004:0.0:1788625392.935797:0:19557:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788625392.935821:0:19557:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.114@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788625392.935825:0:19557:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788625392.935832:0:19557:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788625392.935862:0:19557:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788625392.935866:0:19557:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788625392.949186:0:19557:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.114@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788625392.949248:0:19557:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.114@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788625392.949258:0:19557:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788625392.949260:0:19557:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788625392.949261:0:19557:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625392.949262:0:19557:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625392.949263:0:19557:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625392.949264:0:19557:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625392.949266:0:19557:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625392.949267:0:19557:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625392.949269:0:19557:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788625392.949273:0:19557:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788625392.949275:0:19557:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788625392.949276:0:19557:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788625392.949277:0:19557:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625392.949278:0:19557:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625392.949278:0:19557:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625392.949279:0:19557:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625392.949280:0:19557:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625392.949281:0:19557:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625392.949282:0:19557:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788625392.949322:0:19557:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788625392.949343:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206245632:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788625392.949416:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625392.949568:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884882af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625392.949930:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206245632 00000100:00100000:0.0:1788625392.949938:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206245632 00000100:00100000:0.0:1788625392.950030:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788625392.950040:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:19557:x1875509206245632:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788625392.950072:0:17233:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788625392.950075:0:17233:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788625392.950079:0:17233:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788625392.950369:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:19557:x1875509206245632:12345-0@lo:253:mount.lustre.0 Request processed in 329us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625392.950385:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788625392.950466:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206245632:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788625392.950477:0:19557:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788625392.950480:0:19557:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788625392.950481:0:19557:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788625392.950489:0:19557:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625392.950490:0:19557:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625392.950491:0:19557:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625392.950492:0:19557:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625392.950493:0:19557:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625392.950494:0:19557:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625392.950495:0:19557:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788625392.950529:0:19557:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9987427a5000 from lustre-OST0001 10000000:01000000:3.0:1788625392.950571:0:19557:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788625392.950584:0:19557:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788625392.950594:0:19557:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99887cb18000 local copy 00010000:00010000:3.0:1788625392.950605:0:19557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625392.950705:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206245760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625392.950738:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625392.951082:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625392.951161:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206245760 00000100:00100000:2.0:1788625392.951167:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206245760 00000100:00100000:2.0:1788625392.951194:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788625392.951201:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:19557:x1875509206245760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625392.951291:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:19557:x1875509206245760:12345-0@lo:501:mount.lustre.0 Request processed in 91us (553us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625392.951299:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788625392.951371:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206245760:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788625392.951386:0:19557:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788625392.951403:0:19557:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788625392.951410:0:19557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625392.951420:0:19557:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625392.951449:0:19557:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9987427a5000 10000000:01000000:3.0:1788625392.951454:0:19557:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788625392.951459:0:19557:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788625392.951461:0:19557:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788625392.951465:0:19557:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788625392.951477:0:19557:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788625392.951501:0:19557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625392.951510:0:19557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625392.951557:0:19557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625392.951583:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206245888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625392.951614:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625392.951632:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625392.951794:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206245888 00000100:00100000:2.0:1788625392.951798:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206245888 00000100:00100000:2.0:1788625392.951815:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788625392.951820:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:19557:x1875509206245888:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625392.951834:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625392.951845:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998744188400/0x2d2e3b3f34a7b6ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b6c3 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625392.951864:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998744188400/0x2d2e3b3f34a7b6ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b6c3 expref: 22 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625392.951873:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998744188400/0x2d2e3b3f34a7b6ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b6c3 expref: 22 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625392.951881:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188400, rc 0) 00000100:00100000:2.0:1788625392.951903:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:19557:x1875509206245888:12345-0@lo:101:mount.lustre.0 Request processed in 83us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625392.951909:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788625392.951960:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206245888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625392.951972:0:19557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b6ca expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625392.951981:0:19557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b6ca expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625392.953105:0:19557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788625392.954232:0:19557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625392.958170:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788625392.958226:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788625392.958240:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788625392.958253:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788625392.958266:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788625392.958278:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788625392.958305:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788625392.958310:0:19557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788625392.958442:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625392.958511:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625392.959021:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625392.959088:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206246016 00000100:00100000:1.0:1788625392.959096:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206246016 00000100:00100000:2.0:1788625392.959212:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788625392.959224:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:19557:x1875509206246016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625392.959441:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:19557:x1875509206246016:12345-0@lo:501:mount.lustre.0 Request processed in 219us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625392.959450:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788625392.959794:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625392.959840:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246144:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625392.959886:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625392.959991:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625392.960058:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206246144 00000100:00100000:0.0:1788625392.960063:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206246144 00000100:00100000:0.0:1788625392.960088:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788625392.960094:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:19557:x1875509206246144:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625392.960964:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:19557:x1875509206246144:12345-0@lo:503:mount.lustre.0 Request processed in 862us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625392.960976:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788625392.961090:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246144:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788625392.961850:0:19557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788625392.961974:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625392.962058:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625392.962203:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625392.962362:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206246272 00000100:00100000:1.0:1788625392.962371:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206246272 00000100:00100000:0.0:1788625392.963016:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788625392.963237:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:19557:x1875509206246272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625392.963860:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:19557:x1875509206246272:12345-0@lo:502:mount.lustre.0 Request processed in 830us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625392.963869:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788625392.963983:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625392.964240:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788625392.964279:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788625392.964294:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788625392.964307:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788625392.964322:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788625392.964337:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788625392.964351:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788625392.964364:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788625392.964382:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788625392.964417:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246400:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625392.964464:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625392.964505:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885e645c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625392.964739:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206246400 00000100:00100000:1.0:1788625392.964747:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206246400 00000100:00100000:1.0:1788625392.964788:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788625392.964802:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:19557:x1875509206246400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625392.964911:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:19557:x1875509206246400:12345-0@lo:502:mount.lustre.0 Request processed in 110us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625392.964917:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788625392.965085:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246400:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625392.965130:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788625392.965139:0:19557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788625392.966062:0:19561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788625392.966071:0:19561:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788625392.966083:0:19561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625392.966085:0:19561:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788625392.966092:0:19561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625392.966107:0:19561:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99885e62cd40) 00000020:00000080:0.0:1788625392.966132:0:19561:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788625392.966139:0:19561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788625392.966218:0:19561:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9987427a5000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788625392.966228:0:19561:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788625392.966235:0:19561:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2d2e3b3f34a7b6d8 00010000:00010000:0.0:1788625392.971035:0:19561:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788625392.971449:0:19561:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1788625392.973037:0:19561:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788625392.974462:0:19561:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788625392.974478:0:19561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625392.974486:0:19561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625392.974488:0:19561:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788625392.974493:0:19561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625392.974498:0:19561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625392.974499:0:19561:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788625392.974503:0:19561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788625392.974505:0:19561:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788625392.974507:0:19561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625392.974510:0:19561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625392.974511:0:19561:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788625392.974553:0:19561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625392.974558:0:19561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625392.974559:0:19561:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788625392.974563:0:19561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788625392.974605:0:19561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625392.974608:0:19561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625392.974609:0:19561:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788625392.974613:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788625392.974898:0:19557:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788625392.974931:0:19557:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788625392.974954:0:19557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b6ca expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625392.974968:0:19557:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b6ca expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625392.974978:0:19557:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9987427a5000 from 1 10000000:01000000:3.0:1788625392.974988:0:19557:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625392.975027:0:19557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b6df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625392.975037:0:19557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b6df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625392.975049:0:19557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b6df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625392.975076:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744830000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625392.975176:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625392.975222:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625392.976138:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206246528 00000100:00100000:1.0:1788625392.976150:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206246528 00000100:00100000:1.0:1788625392.976211:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788625392.976221:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:19557:x1875509206246528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625392.976237:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625392.976253:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e5400/0x2d2e3b3f34a7b6e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b6df expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625392.976281:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e5400/0x2d2e3b3f34a7b6e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b6df expref: 23 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625392.976292:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e5400/0x2d2e3b3f34a7b6e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b6df expref: 23 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625392.976302:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5400, rc 0) 00000100:00100000:1.0:1788625392.976369:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:19557:x1875509206246528:12345-0@lo:101:mount.lustre.0 Request processed in 150us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625392.976376:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788625392.976477:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744830000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246528:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625392.976508:0:19557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b6df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b6e6 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625392.976711:0:19557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b6df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b6e6 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625392.977934:0:19557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788625392.978262:0:19557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788625392.978445:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788625392.978475:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788625392.978497:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788625392.978503:0:19557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788625392.980586:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744833100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625392.980762:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625392.980812:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887269f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788625392.980937:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206246656 00000100:00100000:0.0:1788625392.980948:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206246656 00000100:00100000:0.0:1788625392.982365:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788625392.982384:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:19557:x1875509206246656:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625392.982594:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:19557:x1875509206246656:12345-0@lo:501:mount.lustre.0 Request processed in 217us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625392.982603:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788625392.982879:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744833100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625392.982948:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788625392.983011:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625392.986594:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788625392.987285:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206246784 00000100:00100000:1.0:1788625392.987296:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206246784 00000100:00100000:1.0:1788625392.987358:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788625392.987369:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:19557:x1875509206246784:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788625392.987600:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:19557:x1875509206246784:12345-0@lo:503:mount.lustre.0 Request processed in 232us (4588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625392.987620:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788625392.987765:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246784:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788625392.988299:0:19557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788625392.988417:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625392.988491:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625392.990785:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788625392.990930:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206246912 00000100:00100000:1.0:1788625392.990942:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206246912 00000100:00100000:1.0:1788625392.991007:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788625392.991017:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:19557:x1875509206246912:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625392.991209:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:19557:x1875509206246912:12345-0@lo:502:mount.lustre.0 Request processed in 192us (2717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625392.991217:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788625392.992232:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206246912:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788625392.992904:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788625392.992944:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788625392.992960:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788625392.992973:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788625392.992987:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788625392.993001:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788625392.993015:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788625392.993028:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788625392.993041:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788625392.993054:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788625392.993067:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788625392.993111:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206247040:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625392.993190:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625392.993270:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788625392.993336:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206247040 00000100:00100000:3.0:1788625392.993343:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206247040 00000100:00100000:1.0:1788625392.993408:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788625392.993419:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:19557:x1875509206247040:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625392.993875:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:19557:x1875509206247040:12345-0@lo:502:mount.lustre.0 Request processed in 457us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625392.993883:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788625392.993997:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206247040:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625392.994066:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788625392.994083:0:19557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788625392.995175:0:19565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625392.995188:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625392.995191:0:19565:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788625392.995199:0:19565:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9987427a5000 00000020:00000080:0.0:1788625392.995203:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788625392.995212:0:19565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625392.995215:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625392.995229:0:19565:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788625392.995233:0:19565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625392.995237:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625392.995238:0:19565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788625392.995241:0:19565:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9987427a5000 00000020:00000080:0.0:1788625392.995243:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788625392.995312:0:19565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625392.995316:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625392.995317:0:19565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788625392.995320:0:19565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625392.995322:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625392.995324:0:19565:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788625392.995327:0:19565:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9987427a5000 00000020:00000080:0.0:1788625392.995329:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788625392.995348:0:19565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625392.995350:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625392.995352:0:19565:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788625392.995354:0:19565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625392.995357:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625392.995358:0:19565:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788625392.995361:0:19565:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9987427a5000 00000020:00000080:0.0:1788625392.995363:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788625392.995386:0:19565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625392.995390:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625392.995391:0:19565:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788625392.995394:0:19565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788625392.996771:0:19557:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788625392.996809:0:19557:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788625392.996836:0:19557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b6df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b6e6 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625392.996850:0:19557:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b6df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b6e6 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625392.996933:0:19557:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788625392.996936:0:19557:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9987427a5000 10000000:01000000:0.0:1788625392.996939:0:19557:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9987427a5000 10000000:01000000:0.0:1788625392.996944:0:19557:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788625392.996951:0:19557:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9987427a5000 from 1 10000000:01000000:0.0:1788625392.996954:0:19557:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788625392.996994:0:19557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625392.997004:0:19557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625392.997017:0:19557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625392.997043:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206247168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788625392.997117:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625392.997167:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff998878108840 going to sleep for 11 seconds 00000100:00100000:2.0:1788625392.997258:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206247168 00000100:00100000:2.0:1788625392.997267:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206247168 00000100:00100000:2.0:1788625392.997308:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788625392.997319:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:19557:x1875509206247168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625392.997335:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625392.997350:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998744189800/0x2d2e3b3f34a7b6f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b6ed expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625392.997375:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998744189800/0x2d2e3b3f34a7b6f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b6ed expref: 24 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625392.997386:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998744189800/0x2d2e3b3f34a7b6f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b6ed expref: 24 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625392.997402:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744189800, rc 0) 00000100:00100000:2.0:1788625392.997449:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:19557:x1875509206247168:12345-0@lo:101:mount.lustre.0 Request processed in 131us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625392.997456:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788625392.999598:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206247168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625392.999630:0:19557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b6f4 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625393.001848:0:19557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b6f4 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625393.003380:0:19557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1788625393.004071:0:19557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788625393.004303:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788625393.004339:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788625393.004356:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788625393.004373:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788625393.004392:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788625393.004423:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788625393.004441:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788625393.004456:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788625393.004470:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788625393.004482:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788625393.004496:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788625393.004512:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788625393.006912:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788625393.006938:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788625393.006950:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788625393.006962:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788625393.006973:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788625393.006985:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788625393.006996:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788625393.007007:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788625393.007018:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788625393.007045:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788625393.007058:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788625393.007070:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788625393.007082:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788625393.007093:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788625393.007105:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788625393.007116:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788625393.007127:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788625393.007137:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788625393.007148:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788625393.007159:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788625393.007170:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788625393.007181:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788625393.007202:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788625393.007213:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788625393.007224:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788625393.007247:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788625393.007262:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1788625393.007277:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1788625393.007291:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1788625393.007304:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1788625393.007320:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1788625393.007337:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1788625393.007351:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1788625393.007366:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1788625393.007392:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1788625393.007397:0:19557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1788625393.007566:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206247296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625393.012458:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625393.012544:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff998878108000 going to sleep for 11 seconds 00000100:00100000:2.0:1788625393.012665:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206247296 00000100:00100000:2.0:1788625393.012676:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206247296 00000100:00100000:2.0:1788625393.012743:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788625393.012754:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:19557:x1875509206247296:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625393.012926:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:19557:x1875509206247296:12345-0@lo:501:mount.lustre.0 Request processed in 174us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625393.012935:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788625393.013891:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206247296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625393.013948:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206247424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625393.014008:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625393.014053:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff998878108000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625393.014103:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206247424 00000100:00100000:3.0:1788625393.014111:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206247424 00000100:00100000:3.0:1788625393.014165:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788625393.014174:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:19557:x1875509206247424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625393.014380:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:19557:x1875509206247424:12345-0@lo:503:mount.lustre.0 Request processed in 208us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625393.014388:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788625393.014474:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206247424:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788625393.015138:0:19557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788625393.015235:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206247552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625393.015298:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625393.015331:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff998878108840 going to sleep for 11 seconds 00000100:00100000:3.0:1788625393.015463:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206247552 00000100:00100000:3.0:1788625393.015470:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206247552 00000100:00100000:3.0:1788625393.015593:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788625393.015601:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:19557:x1875509206247552:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625393.015708:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:19557:x1875509206247552:12345-0@lo:502:mount.lustre.0 Request processed in 108us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625393.015715:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788625393.018805:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206247552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625393.019112:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788625393.019155:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788625393.019173:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788625393.019192:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788625393.019208:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788625393.019240:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788625393.019258:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788625393.019272:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788625393.019285:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788625393.019299:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788625393.019314:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788625393.019328:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788625393.019341:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788625393.019355:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788625393.019369:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788625393.019384:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788625393.019399:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788625393.019414:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788625393.019429:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788625393.019441:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788625393.019454:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788625393.019483:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788625393.019500:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788625393.019512:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788625393.019555:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788625393.019581:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788625393.019599:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788625393.019614:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788625393.019628:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788625393.019643:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788625393.019657:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788625393.019671:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788625393.019696:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788625393.019713:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788625393.019729:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788625393.019746:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788625393.019760:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788625393.019788:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788625393.019805:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788625393.019818:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788625393.019831:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788625393.019844:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788625393.019858:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788625393.019873:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788625393.019889:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788625393.019904:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788625393.019918:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788625393.019933:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788625393.020013:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206247680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625393.020107:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625393.020177:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206247680 00000100:00100000:0.0:1788625393.020184:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206247680 00000100:00100000:0.0:1788625393.020241:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788625393.020251:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:19557:x1875509206247680:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625393.020370:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:19557:x1875509206247680:12345-0@lo:502:mount.lustre.0 Request processed in 119us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625393.020378:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788625393.020439:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff998878108840 going to sleep for 11 seconds 00000100:00100000:0.0:1788625393.020460:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206247680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625393.027273:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788625393.027364:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788625393.027436:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206247808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625393.027618:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625393.027684:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206247808 00000100:00100000:0.0:1788625393.027692:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206247808 00000100:00100000:0.0:1788625393.027751:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788625393.027762:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:19557:x1875509206247808:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625393.027890:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:19557:x1875509206247808:12345-0@lo:502:mount.lustre.0 Request processed in 129us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625393.027898:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788625393.027951:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff998878108840 going to sleep for 11 seconds 00000100:00100000:0.0:1788625393.027977:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206247808:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625393.028032:0:19557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788625393.028041:0:19557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788625393.033847:0:19570:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788625393.033873:0:19570:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99887da58000) 00000020:00000080:1.0:1788625393.033905:0:19570:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788625393.034021:0:19570:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9987427a5000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788625393.034025:0:19570:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9987427a5000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788625393.034028:0:19570:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9987427a5000 3 00010000:00080000:1.0:1788625393.034065:0:19570:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99887b49b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.114@tcp at head 00010000:00010000:1.0:1788625393.038155:0:19570:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788625393.038372:0:19570:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788625393.038424:0:19570:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788625393.038437:0:19570:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2d2e3b3f34a7b702 00000100:00080000:1.0:1788625393.038450:0:19570:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788625393.038456:0:19570:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99887b49b000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625393.038502:0:19570:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998744184380 x1875509206247936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788625393.038561:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206247936:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788625393.038649:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625393.038718:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206247936 00000100:00100000:1.0:1788625393.038726:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206247936 00000100:00100000:1.0:1788625393.038757:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788625393.038765:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875509206247936:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788625393.038791:0:17241:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:1.0:1788625393.038824:0:17241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2d2e3b3f34a7b709 00000004:00100000:1.0:1788625393.038839:0:17241:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788625393.038869:0:17241:0:(import.c:65:import_set_state_nolock()) ffff99887b49e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625393.038919:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875509206247936:12345-0@lo:38:llog_process_th.0 Request processed in 153us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625393.038928:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788625393.038970:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744184380 x1875509206247936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625393.038982:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788625393.038990:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788625393.038998:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788625393.039002:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788625393.039004:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b49b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788625393.039009:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206247936:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788625393.039027:0:19570:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1788625393.046597:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788625393.046686:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625393.046691:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625393.046694:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625393.046697:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625393.046727:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625393.046730:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788625393.046734:0:38:0:(import.c:65:import_set_state_nolock()) ffff998854e39000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625393.046741:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:0.0:1788625393.046748:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788625393.046755:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998854e39000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625393.046778:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99874482b800 x1875509206248576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788625393.050496:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206248192:0@lo:400:kworker.0 00000100:00100000:3.0:1788625393.050640:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206248448:0@lo:400:kworker.0 00000100:00100000:2.0:1788625393.050750:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625393.050789:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206248832:0@lo:400:kworker.0 00000100:00100000:2.0:1788625393.050811:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625393.050839:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788625393.050846:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206248320:0@lo:400:kworker.0 00000100:00100000:2.0:1788625393.050872:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625393.050890:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206248960:0@lo:400:kworker.0 00000100:00100000:2.0:1788625393.050909:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625393.050948:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206248192 00000100:00100000:2.0:1788625393.050956:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206248192 00000100:00100000:2.0:1788625393.051003:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206248832 00000100:00100000:2.0:1788625393.051007:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206248832 00000100:00100000:2.0:1788625393.051041:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206248960 00000100:00100000:2.0:1788625393.051060:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206248960 00000100:00100000:2.0:1788625393.051098:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788625393.051107:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206248192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625393.051163:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206248192:12345-0@lo:400:kworker.0 Request processed in 57us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625393.051169:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788625393.051186:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788625393.051192:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206248832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625393.051217:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206248832:12345-0@lo:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625393.051222:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788625393.051234:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788625393.051239:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206248960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625393.051264:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206248960:12345-0@lo:400:kworker.0 Request processed in 26us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625393.051271:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788625393.051296:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206248320 00000100:00100000:2.0:1788625393.051300:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206248320 00000100:00100000:2.0:1788625393.051329:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788625393.051335:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206248320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625393.051381:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206248320:12345-0@lo:400:kworker.0 Request processed in 45us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625393.051388:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788625393.051425:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206248320:0@lo:400:kworker.0 00010000:00080000:2.0:1788625393.051438:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439c4a80 x1875509206248960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625393.051460:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206248960:0@lo:400:kworker.0 00010000:00080000:2.0:1788625393.051473:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99874482aa00 x1875509206248192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625393.051482:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206248192:0@lo:400:kworker.0 00010000:00080000:2.0:1788625393.051490:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439c4e00 x1875509206248832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625393.051498:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206248832:0@lo:400:kworker.0 00000100:00100000:3.0:1788625393.052011:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625393.052057:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788625393.052066:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206248064:0@lo:400:kworker.0 00000100:00100000:3.0:1788625393.052110:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625393.052139:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206248704:0@lo:400:kworker.0 00000100:00100000:3.0:1788625393.052161:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625393.052191:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206248704 00000100:00100000:3.0:1788625393.052196:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206248704 00000100:00100000:3.0:1788625393.052228:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788625393.052235:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206248704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625393.052275:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206248704:12345-0@lo:400:kworker.0 Request processed in 40us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625393.052281:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788625393.052321:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744829500 x1875509206248704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625393.052332:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206248704:0@lo:400:kworker.0 00000100:00100000:2.0:1788625393.054855:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206248448 00000100:00100000:2.0:1788625393.054872:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206248448 00000100:00100000:2.0:1788625393.054951:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625393.054961:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206248448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625393.055055:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206248448:12345-0@lo:400:kworker.0 Request processed in 96us (3047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625393.055063:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625393.055205:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206248064 00000100:00100000:0.0:1788625393.055211:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206248064 00000100:00100000:0.0:1788625393.055264:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788625393.055272:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206248064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625393.055316:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206248064:12345-0@lo:400:kworker.0 Request processed in 46us (3206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625393.055323:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788625393.055615:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206248064:0@lo:400:kworker.0 00010000:00080000:2.0:1788625393.055633:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744828e00 x1875509206248448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625393.055644:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206248448:0@lo:400:kworker.0 00000100:00100000:1.0:1788625393.055789:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206248576:0@lo:8:kworker.0 00000100:00100000:1.0:1788625393.055848:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788625393.055933:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788625393.055939:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625393.055942:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625393.056280:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206248576 00000100:00100000:0.0:1788625393.056287:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206248576 00000100:00100000:0.0:1788625393.056319:0:18745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788625393.056325:0:18745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875509206248576:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788625393.056396:0:18745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875509206248576:12345-0@lo:8:kworker.0 Request processed in 69us (547us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788625393.056402:0:18745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788625393.057466:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788625393.057478:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998854e39000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788625393.057483:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788625393.057488:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874482b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206248576:0@lo:8:kworker.0 00000020:01000004:1.0:1788625393.057542:0:19570:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788625393.057583:0:19570:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9987434b19c0) 00000020:00000080:1.0:1788625393.057609:0:19570:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788625393.057710:0:19570:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9987427a5000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788625393.057715:0:19570:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9987427a5000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788625393.057718:0:19570:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9987427a5000 3 00010000:00080000:1.0:1788625393.057747:0:19570:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99887b49b800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.114@tcp at head 00010000:00010000:1.0:1788625393.059386:0:19570:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788625393.060917:0:19570:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788625393.060968:0:19570:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788625393.060981:0:19570:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2d2e3b3f34a7b717 00000100:00080000:0.0:1788625393.060993:0:19570:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788625393.060999:0:19570:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99887b49b800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625393.061037:0:19570:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9987439c5c00 x1875509206249088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625393.061060:0:19570:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788625393.061081:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625393.061085:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625393.061088:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625393.061103:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788625393.062562:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875509206249088:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788625393.062661:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625393.062850:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206249088 00000100:00100000:3.0:1788625393.062869:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206249088 00000100:00100000:3.0:1788625393.062939:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625393.062947:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1875509206249088:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788625393.062977:0:18690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:3.0:1788625393.063027:0:18690:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2d2e3b3f34a7b71e 00000004:00100000:3.0:1788625393.063042:0:18690:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788625393.063074:0:18690:0:(import.c:65:import_set_state_nolock()) ffff998742cf0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625393.063140:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875509206249088:12345-0@lo:38:llog_process_th.0 Request processed in 192us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625393.063148:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1788625393.063281:0:19570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788625393.064506:0:19557:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788625393.064581:0:19557:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788625393.064598:0:19557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b6f4 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.064623:0:19557:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b6f4 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788625393.064675:0:19557:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788625393.064677:0:19557:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788625393.064678:0:19557:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625393.064680:0:19557:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625393.064681:0:19557:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625393.064682:0:19557:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625393.064683:0:19557:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625393.064685:0:19557:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625393.064686:0:19557:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788625393.064690:0:19557:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788625393.064693:0:19557:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788625393.064694:0:19557:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788625393.064695:0:19557:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625393.064696:0:19557:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625393.064697:0:19557:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625393.064698:0:19557:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625393.064699:0:19557:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625393.064701:0:19557:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625393.064702:0:19557:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788625393.064725:0:19557:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788625393.064745:0:19557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206249216:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788625393.064807:0:19557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625393.064842:0:19557:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842d19f00 going to sleep for 11 seconds 00010000:00080000:0.0:1788625393.064958:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439c5c00 x1875509206249088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625393.064970:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788625393.064979:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788625393.064987:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788625393.064992:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788625393.064994:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b49b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788625393.065001:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875509206249088:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788625393.065093:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206249216 00000100:00100000:3.0:1788625393.065100:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206249216 00000100:00100000:3.0:1788625393.065159:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788625393.065169:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:19557:x1875509206249216:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788625393.065198:0:17233:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788625393.065218:0:17233:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788625393.072011:0:17233:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788625393.072034:0:17233:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788625393.072150:0:17255:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788625393.072156:0:17255:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788625393.072184:0:17255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b725 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625393.072209:0:17255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998743ae0e00/0x2d2e3b3f34a7b699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b692 expref: 24 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625393.072218:0:17255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998859be8c00/0x2d2e3b3f34a7b6a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b6a0 expref: 24 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625393.072244:0:17255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b725 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625393.072288:0:17255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998859be8c00/0x2d2e3b3f34a7b6a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7b6a0 expref: 24 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625393.072303:0:17255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998859be8c00/0x2d2e3b3f34a7b6a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b6a0 expref: 24 pid: 17233 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625393.072320:0:17255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744186a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17255:1875509206249344:0@lo:104: 00000100:00100000:1.0:1788625393.072385:0:17255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788625393.072444:0:17255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998743ae0e00/0x2d2e3b3f34a7b699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7b692 expref: 24 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625393.072453:0:17255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998743ae0e00/0x2d2e3b3f34a7b699 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b692 expref: 24 pid: 17234 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625393.072461:0:17255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744079880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17255:1875509206249472:0@lo:104: 00000100:00100000:2.0:1788625393.072483:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206249344 00000100:00100000:1.0:1788625393.072489:0:17255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625393.072493:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206249344 00000100:00100000:1.0:1788625393.072551:0:17255:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885eefab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625393.072567:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206249472 00000100:00100000:2.0:1788625393.072584:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206249472 00000100:00100000:2.0:1788625393.072602:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625393.072612:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744185180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+4:17255:x1875509206249344:12345-0@lo:104: 00010000:00010000:2.0:1788625393.072626:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998743ae0400/0x2d2e3b3f34a7b6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b6a7 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.072717:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625393.072723:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744185180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+4:17255:x1875509206249344:12345-0@lo:104: Request processed in 113us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625393.072731:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625393.072748:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788625393.072753:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+3:17255:x1875509206249472:12345-0@lo:104: 00010000:00010000:2.0:1788625393.072761:0:17223:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b699 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.072792:0:17223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788625393.072797:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+3:17255:x1875509206249472:12345-0@lo:104: Request processed in 45us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625393.072803:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788625393.072822:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625393.072828:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998743ae0400/0x2d2e3b3f34a7b6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b6a7 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.072835:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0400 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625393.072840:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998743ae0400/0x2d2e3b3f34a7b6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7b6a7 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.072848:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998743ae0400/0x2d2e3b3f34a7b6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7b6a7 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625393.072856:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998743ae0400/0x2d2e3b3f34a7b6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7b6a7 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625393.072862:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788625393.072898:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998743ae0400/0x2d2e3b3f34a7b6a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b6a7 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.072905:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625393.072925:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998743ae0400/0x2d2e3b3f34a7b6a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b6a7 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.072931:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998743ae0400/0x2d2e3b3f34a7b6a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b6a7 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.072944:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625393.072947:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b699 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.072952:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9200 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625393.072955:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7b699 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.072961:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7b699 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625393.072966:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7b699 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625393.072971:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788625393.072983:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b692 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b699 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.072988:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625393.072994:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b692 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b699 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.073010:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be9200/0x2d2e3b3f34a7b692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b699 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.073023:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625393.073025:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625393.073027:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625393.073040:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206249600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625393.073070:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625393.073097:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625393.073102:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206249728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625393.073122:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625393.073151:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206249600 00000100:00100000:2.0:1788625393.073156:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206249600 00010000:00010000:2.0:1788625393.073172:0:17224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998859be8c00/0x2d2e3b3f34a7b6a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b6a0 expref: 25 pid: 17233 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625393.073191:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206249728 00000100:00100000:2.0:1788625393.073194:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206249728 00010000:00010000:2.0:1788625393.073204:0:17224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998743ae0e00/0x2d2e3b3f34a7b699 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b692 expref: 26 pid: 17234 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625393.073215:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625393.073221:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+26:3637:x1875509206249600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625393.073230:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625393.073235:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998859be8c00/0x2d2e3b3f34a7b6a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b6a0 expref: 26 pid: 17233 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.073244:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998859be8c00/0x2d2e3b3f34a7b6a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b6a0 expref: 26 pid: 17233 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.073265:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625393.073292:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+26:3637:x1875509206249600:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625393.073298:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625393.073312:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788625393.073318:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744828e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+25:3637:x1875509206249728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625393.073325:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625393.073330:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998743ae0e00/0x2d2e3b3f34a7b699 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b692 expref: 25 pid: 17234 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.073338:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998743ae0e00/0x2d2e3b3f34a7b699 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b692 expref: 25 pid: 17234 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.073349:0:17224:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b725 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.073357:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b725 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788625393.073369:0:17224:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004648846s 00010000:00010000:2.0:1788625393.073374:0:17224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b725 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.073382:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b725 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.073389:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b725 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.073404:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b725 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.073410:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625393.073414:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b725 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.073421:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b725 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.073429:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b725 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625393.073439:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625393.073462:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744828e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+25:3637:x1875509206249728:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625393.073469:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788625393.073553:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206249728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625393.073565:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206249600:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625393.073598:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625393.073941:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:19557:x1875509206249216:12345-0@lo:253:mount.lustre.0 Request processed in 8772us (9132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625393.073950:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788625393.074334:0:19557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:19557:1875509206249216:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788625393.074346:0:19557:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788625393.074350:0:19557:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788625393.074351:0:19557:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788625393.074353:0:19557:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625393.074354:0:19557:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625393.074355:0:19557:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625393.074356:0:19557:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625393.074365:0:19557:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625393.074367:0:19557:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625393.074368:0:19557:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788625393.074378:0:19557:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788625393.074882:0:17255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be8c00/0x2d2e3b3f34a7b6a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b6a0 expref: 23 pid: 17233 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625393.074901:0:17255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744186a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17255:1875509206249344:0@lo:104: 00010000:00010000:1.0:1788625393.074913:0:17255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743ae0e00/0x2d2e3b3f34a7b699 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b692 expref: 22 pid: 17234 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625393.074921:0:17255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744079880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17255:1875509206249472:0@lo:104: 00010000:00010000:1.0:1788625393.074946:0:17255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b725 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625393.074955:0:17255:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b725 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625393.074962:0:17255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b725 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625393.074969:0:17255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7b725 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788625393.084962:0:19557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788625393.089964:0:19557:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788625393.089975:0:19557:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788625393.090013:0:19557:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788625393.090059:0:19557:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.114@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788625393.090079:0:19557:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788625393.090107:0:19557:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788625393.091423:0:19557:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788625393.092954:0:19557:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1788625394.050175:0:19624:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788625394.050420:0:19624:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788625394.060756:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788625394.511764:0:17273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788625394.892767:0:17236:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788625394.892778:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9987427c7800 from 10 10000000:01000000:2.0:1788625394.892786:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788625394.892853:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625394.892868:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625394.892883:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625394.893002:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206249856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788625394.893111:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625394.893182:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff998878108c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625394.893257:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206249856 00000100:00100000:1.0:1788625394.893267:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206249856 00000100:00100000:1.0:1788625394.893376:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788625394.893388:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:17236:x1875509206249856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625394.893408:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625394.893429:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e4200/0x2d2e3b3f34a7b733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b72c expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625394.893461:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e4200/0x2d2e3b3f34a7b733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b72c expref: 23 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625394.893476:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e4200/0x2d2e3b3f34a7b733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b72c expref: 23 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625394.893486:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4200, rc 0) 00000100:00100000:1.0:1788625394.893597:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:17236:x1875509206249856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625394.893613:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788625394.893705:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744828700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206249856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625394.893724:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b733 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625394.893734:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b733 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625394.893798:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744830380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206249984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788625394.898139:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625394.898258:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988512d2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625394.898380:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206249984 00000100:00100000:0.0:1788625394.898396:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206249984 00000100:00100000:0.0:1788625394.898558:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788625394.898573:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:17236:x1875509206249984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788625394.898626:0:17233:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788625394.898655:0:17233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788625394.898659:0:17233:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788625394.898799:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:17236:x1875509206249984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 228us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625394.898809:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788625394.898967:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744830380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206249984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788625394.899074:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788625394.899091:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b733 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625394.899104:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b733 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625394.899117:0:17236:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788625394.899122:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998848aae000 from 10 10000000:01000000:3.0:1788625394.899126:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788625394.899178:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625394.899188:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625394.899199:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625394.899238:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744830380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206250112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625394.899288:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625394.899650:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988512d2780 going to sleep for 11 seconds 00000100:00100000:1.0:1788625394.899754:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206250112 00000100:00100000:1.0:1788625394.899762:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206250112 00000100:00100000:1.0:1788625394.899805:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788625394.899815:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:17236:x1875509206250112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625394.899829:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625394.899849:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7b741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b73a expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625394.899882:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7b741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b73a expref: 24 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625394.899894:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7b741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b73a expref: 24 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625394.899904:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5a00, rc 0) 00000100:00100000:1.0:1788625394.899992:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:17236:x1875509206250112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625394.899999:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788625394.904849:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744830380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206250112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625394.904904:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b741 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625394.904940:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b741 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625394.905050:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744830380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206250240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788625394.905151:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625394.905212:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988512d2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625394.905461:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206250240 00000100:00100000:2.0:1788625394.905471:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206250240 00000100:00100000:2.0:1788625394.905694:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788625394.905705:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:17236:x1875509206250240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788625394.905743:0:17234:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788625394.905760:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788625394.905763:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788625394.905881:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:17236:x1875509206250240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 176us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625394.905903:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788625394.907392:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744830380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206250240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788625394.907493:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788625394.907507:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b741 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625394.907554:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b741 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625394.956799:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206250368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625394.956918:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625394.960310:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206250368 00000100:00100000:0.0:1788625394.960325:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206250368 00000100:00100000:0.0:1788625394.960398:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788625394.960409:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206250368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788625394.960459:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788625394.960615:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206250368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 207us (3696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625394.960630:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788625394.960670:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206250496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625394.960729:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625394.960812:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206250368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625394.960850:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206250496 00000100:00100000:0.0:1788625394.960856:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206250496 00000100:00100000:0.0:1788625394.960894:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788625394.960901:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206250496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625394.960926:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788625394.960966:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206250496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625394.960972:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788625394.960998:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439c5c00 x1875509206250496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625394.961012:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206250496:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788625395.083775:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625395.476789:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206250624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625395.476905:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625395.477893:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206250624 00000100:00100000:0.0:1788625395.477907:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206250624 00000100:00100000:0.0:1788625395.477992:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788625395.478004:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206250624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625395.478067:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788625395.478158:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206250624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625395.478166:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788625395.478924:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206250624:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788625396.110930:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625397.134558:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625397.204975:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625377/real 1788625377] req@ffff998744184e00 x1875509206236416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625397 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625397.205031:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998744184e00 x1875509206236416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625397 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625397.205043:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625377/real 1788625377] req@ffff998744186d80 x1875509206236544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625397 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625397.205055:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998744186d80 x1875509206236544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625397 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788625397.205085:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998844cd0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625397.205122:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788625397.205156:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744184e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206236416:0@lo:8:kworker.0 00000100:00080000:3.0:1788625397.205164:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998874b50000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625397.205171:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788625397.205175:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744186d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206236544:0@lo:8:kworker.0 00000100:00080000:0.0:1788625397.205501:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625397.205506:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788625397.205510:0:37:0:(import.c:65:import_set_state_nolock()) ffff998844cd0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625397.205575:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:0.0:1788625397.205583:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788625397.205592:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff998844cd0800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625397.205621:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9987439c6300 x1875509206251008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625397.205633:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625397.205636:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788625397.205638:0:37:0:(import.c:65:import_set_state_nolock()) ffff998874b50000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625397.205641:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:0.0:1788625397.205644:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788625397.205648:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff998874b50000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625397.205660:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9987439c6a00 x1875509206251136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625397.205689:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625397.205693:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788625397.205695:0:37:0:(import.c:65:import_set_state_nolock()) ffff998854e39000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625397.205701:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998854e39000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625397.205713:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9987439c5180 x1875509206251648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625397.205782:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206250880:0@lo:400:kworker.0 00000100:00100000:0.0:1788625397.205882:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625397.205941:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206251776:0@lo:400:kworker.0 00000100:00100000:0.0:1788625397.205973:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625397.205995:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206252288:0@lo:400:kworker.0 00000100:00100000:0.0:1788625397.206016:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625397.206037:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788625397.206042:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206251264:0@lo:400:kworker.0 00000100:00100000:0.0:1788625397.206065:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625397.206082:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206251904:0@lo:400:kworker.0 00000100:00100000:0.0:1788625397.206113:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625397.206154:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206250880 00000100:00100000:0.0:1788625397.206166:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206250880 00000100:00100000:0.0:1788625397.206234:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788625397.206245:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206250880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625397.206320:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206250880:12345-0@lo:400:kworker.0 Request processed in 76us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625397.206330:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788625397.206366:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206251776 00000100:00100000:0.0:1788625397.206370:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206251776 00000100:00100000:0.0:1788625397.206393:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206252288 00000100:00100000:0.0:1788625397.206396:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206252288 00000100:00100000:0.0:1788625397.206427:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206251264 00000100:00100000:0.0:1788625397.206430:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206251264 00000100:00100000:0.0:1788625397.206441:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206251904 00000100:00100000:0.0:1788625397.206444:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206251904 00000100:00100000:0.0:1788625397.206461:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788625397.206467:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206251776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625397.206547:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206251776:12345-0@lo:400:kworker.0 Request processed in 49us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625397.206566:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788625397.206579:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788625397.206585:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206252288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625397.206613:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206252288:12345-0@lo:400:kworker.0 Request processed in 29us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625397.206619:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788625397.206631:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788625397.206636:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206251264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625397.206662:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206251264:12345-0@lo:400:kworker.0 Request processed in 26us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625397.206668:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788625397.206678:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788625397.206683:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206251904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625397.206707:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206251904:12345-0@lo:400:kworker.0 Request processed in 24us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625397.206712:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788625397.206743:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788625397.206750:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788625397.206782:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439c4700 x1875509206251264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625397.206797:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206251264:0@lo:400:kworker.0 00010000:00080000:0.0:1788625397.206808:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439c5f80 x1875509206251904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625397.206816:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206251904:0@lo:400:kworker.0 00000100:00100000:0.0:1788625397.206838:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206250880:0@lo:400:kworker.0 00010000:00080000:0.0:1788625397.206849:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439c4000 x1875509206251776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625397.206857:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206251776:0@lo:400:kworker.0 00010000:00080000:0.0:1788625397.206866:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439c4380 x1875509206252288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625397.206874:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206252288:0@lo:400:kworker.0 00000100:00100000:3.0:1788625397.207787:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3638:1875509206250752:0@lo:400:kworker.0 00000100:00100000:3.0:1788625397.207863:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625397.207934:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206251520:0@lo:400:kworker.0 00000100:00100000:3.0:1788625397.207969:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625397.208001:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206252160:0@lo:400:kworker.0 00000100:00100000:3.0:1788625397.208036:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625397.208061:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788625397.208068:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206251392:0@lo:400:kworker.0 00000100:00100000:3.0:1788625397.208094:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625397.208113:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206252032:0@lo:400:kworker.0 00000100:00100000:3.0:1788625397.208137:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625397.208176:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206252160 00000100:00100000:3.0:1788625397.208184:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206252160 00000100:00100000:3.0:1788625397.208239:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206252032 00000100:00100000:3.0:1788625397.208242:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206252032 00000100:00100000:3.0:1788625397.208263:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788625397.208272:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206252160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625397.208333:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788625397.208335:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206252160:12345-0@lo:400:kworker.0 Request processed in 64us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625397.208343:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788625397.208346:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206252032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625397.208385:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206252032:12345-0@lo:400:kworker.0 Request processed in 44us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625397.208388:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206251520 00000100:00100000:2.0:1788625397.208392:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788625397.208407:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206251520 00000100:00100000:2.0:1788625397.208415:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206251392 00000100:00100000:2.0:1788625397.208417:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206251392 00000100:00100000:3.0:1788625397.208443:0:18745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625397.208443:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788625397.208449:0:18745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206251520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625397.208449:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206251392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625397.208481:0:18745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206251520:12345-0@lo:400:kworker.0 Request processed in 33us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625397.208481:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206251392:12345-0@lo:400:kworker.0 Request processed in 32us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625397.208501:0:18745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625397.208501:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788625397.208738:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206251008:0@lo:8:kworker.0 00000100:00100000:2.0:1788625397.208787:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625397.208816:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206251136:0@lo:8:kworker.0 00000100:00100000:2.0:1788625397.208896:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625397.208918:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206251648:0@lo:8:kworker.0 00000100:00100000:2.0:1788625397.208956:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625397.208994:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206251008 00000100:00100000:2.0:1788625397.208999:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206251008 00000100:00100000:2.0:1788625397.209015:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206251136 00000100:00100000:2.0:1788625397.209017:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206251136 00000100:00100000:2.0:1788625397.209026:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206251648 00000100:00100000:2.0:1788625397.209028:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206251648 00000100:00100000:2.0:1788625397.209038:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788625397.209044:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875509206251008:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788625397.209088:0:18747:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:2.0:1788625397.209155:0:18747:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7b748 00002000:00100000:2.0:1788625397.209199:0:18747:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9987426b6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788625397.209204:0:18747:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788625397.209209:0:18747:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788625397.209350:0:18747:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788625397.209666:0:18747:0:(import.c:65:import_set_state_nolock()) ffff9987426b2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625397.209745:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1875509206251008:12345-0@lo:8:kworker.0 Request processed in 698us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625397.209757:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788625397.209778:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625397.209787:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875509206251136:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788625397.209808:0:18747:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:2.0:1788625397.209833:0:18747:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7b74f 00002000:00100000:2.0:1788625397.209851:0:18747:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9987426b1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788625397.209855:0:18747:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788625397.209858:0:18747:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788625397.210082:0:18747:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788625397.210104:0:18747:0:(import.c:65:import_set_state_nolock()) ffff9987426b3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625397.210145:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1875509206251136:12345-0@lo:8:kworker.0 Request processed in 356us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625397.210152:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625397.210330:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788625397.210341:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875509206251648:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788625397.210473:0:18747:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:2.0:1788625397.210513:0:18747:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7b756 00002000:00100000:2.0:1788625397.210554:0:18747:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9987426b7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788625397.210558:0:18747:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788625397.210561:0:18747:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788625397.210596:0:18747:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788625397.210629:0:18747:0:(import.c:65:import_set_state_nolock()) ffff9987426b3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625397.210671:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3634:x1875509206251648:12345-0@lo:8:kworker.0 Request processed in 329us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625397.210678:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788625397.210762:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439c6300 x1875509206251008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625397.210775:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788625397.210785:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788625397.210795:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788625397.210801:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788625397.210812:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998844cd0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788625397.210838:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788625397.210845:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206251008:0@lo:8:kworker.0 00010000:00080000:2.0:1788625397.210864:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439c6a00 x1875509206251136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625397.210872:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788625397.210876:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788625397.210883:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788625397.210886:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788625397.210888:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998874b50000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788625397.210916:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788625397.210920:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206251136:0@lo:8:kworker.0 00010000:00080000:2.0:1788625397.210933:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439c5180 x1875509206251648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788625397.210943:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788625397.210948:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788625397.210951:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788625397.210953:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998854e39000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788625397.210967:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788625397.210970:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206251648:0@lo:8:kworker.0 00000004:00080000:2.0:1788625397.211056:0:17266:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1788625397.211082:0:17266:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17266:1875509206252544:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788625397.211128:0:17266:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625397.211156:0:17266:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842d19d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625397.211178:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206252416:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788625397.212386:0:17265:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788625397.212392:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206250752 00000100:00100000:0.0:1788625397.212407:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206250752 00000100:00100000:0.0:1788625397.212472:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788625397.212484:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3638:x1875509206250752:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1788625397.212559:0:17265:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 518320041106ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788625397.212568:0:17265:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788625397.212602:0:17981:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788625397.212664:0:17981:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 518320146446ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788625397.212670:0:17981:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788625397.212700:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3638:x1875509206250752:12345-0@lo:400:kworker.0 Request processed in 218us (4837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625397.212708:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000004:00080000:0.0:1788625397.212750:0:17263:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788625397.212802:0:17263:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 518320283933ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788625397.212807:0:17263:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788625397.213069:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625397.213140:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206252416 00000100:00100000:2.0:1788625397.213146:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206252416 00000100:00100000:0.0:1788625397.213453:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206252544 00000100:00100000:0.0:1788625397.213459:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206252544 00000100:00100000:0.0:1788625397.213508:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788625397.213536:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:17266:x1875509206252544:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:3.0:1788625397.213710:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625397.213721:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625397.213725:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625397.213728:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1788625397.213787:0:17264:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788625397.213818:0:17264:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744833100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17264:1875509206252800:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788625397.213821:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625397.213835:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875509206252416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788625397.213866:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788625397.213877:0:17264:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625397.213914:0:17264:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988726c8900 going to sleep for 11 seconds 00000004:00080000:3.0:1788625397.213958:0:17982:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788625397.213978:0:17982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17982:1875509206253056:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788625397.213978:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875509206252416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625397.213988:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788625397.214011:0:17982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625397.214018:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206252672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625397.214026:0:17982:0:(client.c:2716:ptlrpc_set_wait()) set ffff998848ad2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788625397.214047:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206252928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625397.214047:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625397.214076:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625397.214089:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206252672 00000100:00100000:2.0:1788625397.214094:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206252672 00000100:00100000:3.0:1788625397.214122:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206251392:0@lo:400:kworker.0 00000100:00100000:2.0:1788625397.214125:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206252928 00000100:00100000:2.0:1788625397.214129:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206252928 00010000:00080000:3.0:1788625397.214149:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439c7b80 x1875509206252032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625397.214158:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788625397.214161:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206252032:0@lo:400:kworker.0 00000100:00100000:2.0:1788625397.214163:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875509206252672:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625397.214174:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3638:1875509206250752:0@lo:400:kworker.0 00002000:00000024:2.0:1788625397.214193:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00010000:00080000:3.0:1788625397.214204:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439c6d80 x1875509206251520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625397.214214:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206251520:0@lo:400:kworker.0 00000100:00100000:2.0:1788625397.214226:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875509206252672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (180us total) trans 0 rc 0/0 00010000:00080000:3.0:1788625397.214229:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987439c7480 x1875509206252160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625397.214233:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788625397.214238:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206252160:0@lo:400:kworker.0 00000100:00100000:2.0:1788625397.214244:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788625397.214260:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875509206252928:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788625397.214270:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788625397.214271:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1788625397.214273:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625397.214304:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875509206252928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625397.214308:0:18746:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788625397.214316:0:18746:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788625397.214318:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788625397.214334:0:18745:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788625397.214342:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206252800 00010000:00080000:2.0:1788625397.214342:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744832680 x1875509206252672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625397.214345:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206252800 00000100:00100000:2.0:1788625397.214358:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206252672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625397.214362:0:18745:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788625397.214365:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206253056 00000100:00100000:3.0:1788625397.214367:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206253056 00010000:00080000:2.0:1788625397.214391:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744831180 x1875509206252928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788625397.214392:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987442d6a00 x1875509206252416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625397.214403:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206252928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625397.214407:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206252416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625397.231152:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788625397.231193:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17264:x1875509206252800:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788625397.239510:0:19755:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788625397.239557:0:19755:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788625397.239567:0:19755:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00080000:1.0:1788625397.240433:0:18747:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788625397.240456:0:18747:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788625397.240465:0:18747:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000004:00080000:0.0:1788625397.240643:0:17219:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788625397.255309:0:17219:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1788625397.264135:0:17997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00002000:00010000:3.0:1788625397.268340:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.268365:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b75d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.268419:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.268425:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.268434:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b75d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.269718:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b75d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.269736:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b75d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.269746:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b75d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.269829:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625397.280917:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.280942:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b75d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.280961:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.280968:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b75d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.280983:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b75d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.281028:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b75d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.281037:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b75d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.285940:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.285973:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.285978:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788625397.286311:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.286325:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b764 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.286349:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.286355:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.286364:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b764 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.286381:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b764 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.286408:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b764 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.286417:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b764 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.286439:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625397.287652:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.287664:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b764 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.287677:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.287683:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b764 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.287696:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b764 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.287723:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b764 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.287731:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b764 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.287764:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.287766:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.287768:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788625397.288067:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.288075:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b76b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.288089:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.288093:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.288100:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b76b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.288113:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b76b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.288123:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b76b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.288132:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b76b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.288176:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788625397.289233:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.289325:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b772 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.289342:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.289347:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.289354:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b772 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.289368:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b772 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.289379:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b772 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.289387:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b772 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.289418:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788625397.290294:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625397.290304:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b76b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.290315:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.290320:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b76b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.290341:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b76b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.290364:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b76b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.290373:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b76b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.290401:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.290406:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b772 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.290413:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.290417:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b772 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.290424:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b772 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.290450:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b772 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.290458:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b772 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.290499:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.290501:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.290503:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.291105:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788625397.291298:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.291309:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b779 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.291326:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.291339:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.291349:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b779 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.291365:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b779 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.291376:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b779 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.291384:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b779 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.291416:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788625397.292859:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625397.292871:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b780 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.292889:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788625397.292893:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625397.292901:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b780 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.292921:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b780 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.292933:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b780 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.292942:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b780 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.292961:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788625397.293313:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625397.293328:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b779 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.293343:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625397.293348:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b779 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.293360:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b779 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.293391:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b779 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.293399:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b779 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.293429:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625397.293435:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b780 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.293443:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625397.293446:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b780 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.293454:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b780 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.293479:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b780 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.293497:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b780 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.293513:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.293515:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.293572:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.293585:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788625397.293661:0:17970:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:2.0:1788625397.293885:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625397.293895:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b787 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.293921:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788625397.293924:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625397.293931:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b787 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.293942:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b787 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.293952:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b787 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.293961:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b787 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.293988:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625397.294586:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625397.294595:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b787 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.294605:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625397.294610:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b787 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.294717:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b787 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.294736:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b787 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.294745:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b787 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.294778:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.294780:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.294782:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788625397.295907:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.295919:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b78e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.295935:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.295940:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.295947:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b78e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.295960:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b78e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.295971:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b78e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.295994:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b78e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.296026:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625397.296464:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625397.296472:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b78e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.296481:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625397.296495:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b78e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.296506:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b78e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.296543:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b78e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.296560:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b78e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.296584:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.296586:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.296588:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625397.297766:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625397.297779:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7b795 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.297808:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788625397.297812:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625397.297820:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7b795 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.297834:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7b795 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.297846:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7b795 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.297854:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7b795 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.297880:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788625397.298169:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.298176:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b022a44d/0x2d2e3b3f34a7b79c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.298186:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.298190:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.298194:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b022a44d/0x2d2e3b3f34a7b79c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.298205:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b022a44d/0x2d2e3b3f34a7b79c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.298213:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b022a44d/0x2d2e3b3f34a7b79c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.298221:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b022a44d/0x2d2e3b3f34a7b79c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.298239:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788625397.298392:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625397.298400:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7b795 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.298410:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.298415:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7b795 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.298424:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7b795 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.298847:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7b795 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.298856:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7b795 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.298876:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.298880:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b022a44d/0x2d2e3b3f34a7b79c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.298887:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.298891:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b022a44d/0x2d2e3b3f34a7b79c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.298899:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b022a44d/0x2d2e3b3f34a7b79c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.298911:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b022a44d/0x2d2e3b3f34a7b79c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.298918:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b022a44d/0x2d2e3b3f34a7b79c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.298931:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.298933:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.298941:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.299082:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788625397.302258:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.302293:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098a5a29f/0x2d2e3b3f34a7b7a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.302315:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.302321:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.302328:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098a5a29f/0x2d2e3b3f34a7b7a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.302346:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098a5a29f/0x2d2e3b3f34a7b7a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.302358:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098a5a29f/0x2d2e3b3f34a7b7a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.302367:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098a5a29f/0x2d2e3b3f34a7b7a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.302393:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788625397.303040:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.303048:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b7aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.303059:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.303062:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.303067:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b7aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.303077:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b7aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.303094:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b7aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.303102:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b7aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.303128:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788625397.303503:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625397.303514:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098a5a29f/0x2d2e3b3f34a7b7a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.303539:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9600 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.303545:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098a5a29f/0x2d2e3b3f34a7b7a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.303565:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098a5a29f/0x2d2e3b3f34a7b7a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.303586:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098a5a29f/0x2d2e3b3f34a7b7a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.303595:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098a5a29f/0x2d2e3b3f34a7b7a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.303620:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.303624:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b7aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.303630:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.303633:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b7aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.303640:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b7aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.303662:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b7aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.303669:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d90afa8/0x2d2e3b3f34a7b7aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.303687:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.303689:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.303692:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788625397.303903:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.303910:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b7b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.303920:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.303923:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.303929:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b7b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.303941:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b7b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.303950:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b7b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.303957:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.303996:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625397.304077:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625397.304091:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.304101:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625397.304105:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.304116:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b7b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.304134:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b7b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.304143:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012c9e20e/0x2d2e3b3f34a7b7b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.304171:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625397.304173:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625397.304175:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.304635:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788625397.304709:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.304716:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b7b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.304726:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.304730:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.304735:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b7b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.304744:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b7b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.304753:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b7b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.304761:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b7b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.304784:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788625397.305085:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.305091:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b7bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.305100:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.305110:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.305114:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b7bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.305125:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b7bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.305133:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b7bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.305140:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b7bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.305194:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788625397.308025:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.308043:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc716b5d/0x2d2e3b3f34a7b7c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.308068:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.308073:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.308083:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc716b5d/0x2d2e3b3f34a7b7c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.308099:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc716b5d/0x2d2e3b3f34a7b7c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.308111:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc716b5d/0x2d2e3b3f34a7b7c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.308129:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc716b5d/0x2d2e3b3f34a7b7c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625397.308371:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625397.308378:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7b7cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.308388:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788625397.308391:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625397.308395:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7b7cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.308406:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7b7cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.308427:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7b7cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.308434:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7b7cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.309994:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788625397.310012:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b7b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310029:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.310034:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b7b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310047:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b7b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310074:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b7b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310082:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d3c1b99/0x2d2e3b3f34a7b7b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310142:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788625397.310148:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b7bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310158:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.310161:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b7bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310169:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b7bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310180:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b7bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310188:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ba6f21a/0x2d2e3b3f34a7b7bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310208:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625397.310212:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc716b5d/0x2d2e3b3f34a7b7c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310219:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840031c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.310222:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc716b5d/0x2d2e3b3f34a7b7c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310255:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc716b5d/0x2d2e3b3f34a7b7c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310268:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc716b5d/0x2d2e3b3f34a7b7c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310278:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.310283:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7b7cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310289:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.310292:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7b7cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310299:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7b7cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310311:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7b7cd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.310318:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.310320:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.310322:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625397.316906:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.317450:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788625397.317466:0:18747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7b7cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.317651:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788625397.317662:0:19755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc716b5d/0x2d2e3b3f34a7b7c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.318337:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625397.318346:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788625397.318761:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1788625397.318765:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.318772:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c073537/0x2d2e3b3f34a7b7d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.318774:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008654ee06/0x2d2e3b3f34a7b7db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.318803:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788625397.318803:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788625397.318814:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.318815:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.318831:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c073537/0x2d2e3b3f34a7b7d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.318832:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008654ee06/0x2d2e3b3f34a7b7db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.318855:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c073537/0x2d2e3b3f34a7b7d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.318863:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008654ee06/0x2d2e3b3f34a7b7db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.318869:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c073537/0x2d2e3b3f34a7b7d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.318874:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008654ee06/0x2d2e3b3f34a7b7db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.318885:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c073537/0x2d2e3b3f34a7b7d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.318904:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008654ee06/0x2d2e3b3f34a7b7db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.318937:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788625397.318949:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788625397.319169:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625397.319178:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008654ee06/0x2d2e3b3f34a7b7db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.319195:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.319201:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008654ee06/0x2d2e3b3f34a7b7db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.319212:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008654ee06/0x2d2e3b3f34a7b7db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.319232:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008654ee06/0x2d2e3b3f34a7b7db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.319240:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008654ee06/0x2d2e3b3f34a7b7db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.319274:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.319277:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c073537/0x2d2e3b3f34a7b7d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.319285:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840030600 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.319288:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c073537/0x2d2e3b3f34a7b7d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.319296:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c073537/0x2d2e3b3f34a7b7d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.319306:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c073537/0x2d2e3b3f34a7b7d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.319320:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c073537/0x2d2e3b3f34a7b7d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.319338:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.319340:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.319343:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625397.319390:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625397.319395:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7b7e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.319405:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788625397.319408:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625397.319413:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7b7e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.319422:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7b7e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.319430:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7b7e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.319437:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7b7e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.319458:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625397.319758:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.319765:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7b7e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.319773:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.319777:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7b7e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.319864:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7b7e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.319876:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7b7e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.319883:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7b7e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.319907:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.319909:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.319910:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788625397.320099:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.320107:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f4d0f2a/0x2d2e3b3f34a7b7e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.320117:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.320121:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.320126:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f4d0f2a/0x2d2e3b3f34a7b7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.320135:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f4d0f2a/0x2d2e3b3f34a7b7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.320144:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f4d0f2a/0x2d2e3b3f34a7b7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.320151:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f4d0f2a/0x2d2e3b3f34a7b7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.320168:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625397.320597:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.320603:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f4d0f2a/0x2d2e3b3f34a7b7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.320612:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840030800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.320616:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f4d0f2a/0x2d2e3b3f34a7b7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.320625:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f4d0f2a/0x2d2e3b3f34a7b7e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.320640:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f4d0f2a/0x2d2e3b3f34a7b7e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.320648:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f4d0f2a/0x2d2e3b3f34a7b7e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.320669:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.320671:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.320673:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788625397.320909:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.320916:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e154ef63/0x2d2e3b3f34a7b7f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.320925:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.320938:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.320943:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e154ef63/0x2d2e3b3f34a7b7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.320953:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e154ef63/0x2d2e3b3f34a7b7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.320961:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e154ef63/0x2d2e3b3f34a7b7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.320968:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e154ef63/0x2d2e3b3f34a7b7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.320988:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625397.321218:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.321223:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e154ef63/0x2d2e3b3f34a7b7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.321231:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840030e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.321234:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e154ef63/0x2d2e3b3f34a7b7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.321267:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e154ef63/0x2d2e3b3f34a7b7f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.321279:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e154ef63/0x2d2e3b3f34a7b7f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.321286:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e154ef63/0x2d2e3b3f34a7b7f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.321303:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.321305:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.321306:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788625397.321455:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.321461:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912916b2/0x2d2e3b3f34a7b7f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.321470:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.321473:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.321477:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912916b2/0x2d2e3b3f34a7b7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.321496:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912916b2/0x2d2e3b3f34a7b7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.321505:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912916b2/0x2d2e3b3f34a7b7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.321655:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000912916b2/0x2d2e3b3f34a7b7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.321675:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625397.321875:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.321880:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000912916b2/0x2d2e3b3f34a7b7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.321888:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840031e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.321891:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000912916b2/0x2d2e3b3f34a7b7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.321901:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000912916b2/0x2d2e3b3f34a7b7f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.321913:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000912916b2/0x2d2e3b3f34a7b7f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.321932:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912916b2/0x2d2e3b3f34a7b7f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.321949:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.321951:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.321952:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788625397.322035:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.322042:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1facfcb/0x2d2e3b3f34a7b7fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.322050:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.322054:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.322058:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1facfcb/0x2d2e3b3f34a7b7fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.322067:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1facfcb/0x2d2e3b3f34a7b7fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.322075:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1facfcb/0x2d2e3b3f34a7b7fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.322081:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1facfcb/0x2d2e3b3f34a7b7fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.322142:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788625397.324623:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.324645:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9a5448b/0x2d2e3b3f34a7b805 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.324686:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.324692:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.324702:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9a5448b/0x2d2e3b3f34a7b805 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.324718:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9a5448b/0x2d2e3b3f34a7b805 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.324730:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9a5448b/0x2d2e3b3f34a7b805 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.324738:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9a5448b/0x2d2e3b3f34a7b805 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.326537:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625397.326680:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1facfcb/0x2d2e3b3f34a7b7fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.326696:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840030a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.326703:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1facfcb/0x2d2e3b3f34a7b7fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.326717:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1facfcb/0x2d2e3b3f34a7b7fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.326744:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1facfcb/0x2d2e3b3f34a7b7fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.326753:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1facfcb/0x2d2e3b3f34a7b7fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.326793:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.326798:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9a5448b/0x2d2e3b3f34a7b805 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.326830:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840031200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.326833:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9a5448b/0x2d2e3b3f34a7b805 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.326841:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9a5448b/0x2d2e3b3f34a7b805 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.326853:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9a5448b/0x2d2e3b3f34a7b805 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.326861:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.326863:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.326865:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.327571:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788625397.327581:0:19755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9a5448b/0x2d2e3b3f34a7b805 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625397.327830:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625397.327850:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b80c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.327874:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788625397.327879:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625397.327887:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b80c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.327904:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b80c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.327914:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b80c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.327922:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b80c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.327934:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625397.328078:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.328087:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b80c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.328095:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.328099:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b80c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.328108:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b80c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.328125:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b80c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.328142:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072d77e20/0x2d2e3b3f34a7b80c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.328165:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.328167:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.328169:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625397.328401:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625397.328408:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b813 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.328417:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788625397.328420:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625397.328425:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.328436:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.328457:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.328466:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.328498:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625397.328570:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.328575:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.328583:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.328586:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.328594:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b813 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.328605:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b813 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.328613:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077e014e6/0x2d2e3b3f34a7b813 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.328629:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.328631:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.328632:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625397.329469:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625397.329480:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ba98a42/0x2d2e3b3f34a7b81a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.329504:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788625397.329507:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625397.329513:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ba98a42/0x2d2e3b3f34a7b81a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.329548:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ba98a42/0x2d2e3b3f34a7b81a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.329558:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ba98a42/0x2d2e3b3f34a7b81a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.329566:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ba98a42/0x2d2e3b3f34a7b81a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788625397.329640:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.329647:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e722bd81/0x2d2e3b3f34a7b821 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.329657:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.329661:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.329665:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e722bd81/0x2d2e3b3f34a7b821 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.329673:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625397.329692:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e722bd81/0x2d2e3b3f34a7b821 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.329700:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e722bd81/0x2d2e3b3f34a7b821 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.329708:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e722bd81/0x2d2e3b3f34a7b821 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.329718:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788625397.329918:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625397.329927:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ba98a42/0x2d2e3b3f34a7b81a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.329935:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882044600 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.329940:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ba98a42/0x2d2e3b3f34a7b81a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.329949:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ba98a42/0x2d2e3b3f34a7b81a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.329967:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ba98a42/0x2d2e3b3f34a7b81a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.329974:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ba98a42/0x2d2e3b3f34a7b81a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.329996:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.330000:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e722bd81/0x2d2e3b3f34a7b821 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.330006:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998840031800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.330009:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e722bd81/0x2d2e3b3f34a7b821 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.330017:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e722bd81/0x2d2e3b3f34a7b821 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.330111:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e722bd81/0x2d2e3b3f34a7b821 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.330121:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e722bd81/0x2d2e3b3f34a7b821 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.330141:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.330143:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.330146:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625397.330248:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625397.330254:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000875c3637/0x2d2e3b3f34a7b828 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.330263:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788625397.330266:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625397.330271:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000875c3637/0x2d2e3b3f34a7b828 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.330281:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000875c3637/0x2d2e3b3f34a7b828 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.330289:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000875c3637/0x2d2e3b3f34a7b828 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.330298:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000875c3637/0x2d2e3b3f34a7b828 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.330319:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625397.330340:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.330346:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000875c3637/0x2d2e3b3f34a7b828 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.330353:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882044c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.330357:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000875c3637/0x2d2e3b3f34a7b828 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.330366:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000875c3637/0x2d2e3b3f34a7b828 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.330378:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000875c3637/0x2d2e3b3f34a7b828 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.330385:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000875c3637/0x2d2e3b3f34a7b828 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.330412:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.330414:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.330416:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625397.330730:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625397.330736:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a31745d/0x2d2e3b3f34a7b82f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.330745:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788625397.330749:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625397.330754:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a31745d/0x2d2e3b3f34a7b82f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.330765:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a31745d/0x2d2e3b3f34a7b82f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.330774:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a31745d/0x2d2e3b3f34a7b82f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.330780:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a31745d/0x2d2e3b3f34a7b82f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.330800:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788625397.331083:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625397.331090:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b836 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.331109:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788625397.331112:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625397.331116:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b836 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.331125:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b836 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.331134:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b836 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.331141:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.331149:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788625397.331638:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625397.331648:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a31745d/0x2d2e3b3f34a7b82f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.331657:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625397.331660:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a31745d/0x2d2e3b3f34a7b82f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.331670:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a31745d/0x2d2e3b3f34a7b82f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.331694:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a31745d/0x2d2e3b3f34a7b82f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.331702:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a31745d/0x2d2e3b3f34a7b82f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.331738:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625397.331742:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.331749:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625397.331752:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.331761:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b836 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.331771:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b836 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.331778:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b836 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.331790:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.331792:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.331793:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788625397.331864:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.331870:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b83d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.331880:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.331890:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.331897:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.331908:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.331916:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.331923:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b83d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.331938:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625397.332092:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625397.332097:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b83d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.332104:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625397.332107:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b83d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.332115:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b83d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.332126:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b83d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.332150:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b83d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.332166:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.332168:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.332170:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625397.333867:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625397.334722:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625397.334737:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037db211a/0x2d2e3b3f34a7b844 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.334760:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788625397.334781:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625397.334789:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037db211a/0x2d2e3b3f34a7b844 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.334807:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037db211a/0x2d2e3b3f34a7b844 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.334819:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037db211a/0x2d2e3b3f34a7b844 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.334827:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037db211a/0x2d2e3b3f34a7b844 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.334846:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625397.335508:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625397.335543:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037db211a/0x2d2e3b3f34a7b844 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.335562:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0600 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625397.335569:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037db211a/0x2d2e3b3f34a7b844 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.335581:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037db211a/0x2d2e3b3f34a7b844 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.335603:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037db211a/0x2d2e3b3f34a7b844 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.335611:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037db211a/0x2d2e3b3f34a7b844 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.335635:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.335637:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.335639:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625397.336593:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625397.336607:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052ea6252/0x2d2e3b3f34a7b84b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.336625:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788625397.336630:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625397.336637:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052ea6252/0x2d2e3b3f34a7b84b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.336651:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052ea6252/0x2d2e3b3f34a7b84b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.336661:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052ea6252/0x2d2e3b3f34a7b84b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.336681:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052ea6252/0x2d2e3b3f34a7b84b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.336702:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625397.336716:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625397.336721:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052ea6252/0x2d2e3b3f34a7b84b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.336728:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625397.336732:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052ea6252/0x2d2e3b3f34a7b84b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.336740:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052ea6252/0x2d2e3b3f34a7b84b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.336756:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052ea6252/0x2d2e3b3f34a7b84b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.336763:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052ea6252/0x2d2e3b3f34a7b84b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.336779:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625397.336781:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625397.336783:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625397.340971:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625397.341007:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de568dce/0x2d2e3b3f34a7b852 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.341030:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788625397.341037:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625397.341045:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de568dce/0x2d2e3b3f34a7b852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.341066:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de568dce/0x2d2e3b3f34a7b852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.341078:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de568dce/0x2d2e3b3f34a7b852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.341086:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de568dce/0x2d2e3b3f34a7b852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.341120:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625397.343507:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625397.343541:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de568dce/0x2d2e3b3f34a7b852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.343688:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625397.343695:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de568dce/0x2d2e3b3f34a7b852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.343710:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de568dce/0x2d2e3b3f34a7b852 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.343754:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de568dce/0x2d2e3b3f34a7b852 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.343762:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de568dce/0x2d2e3b3f34a7b852 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.343788:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.343789:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.343791:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625397.343965:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625397.343974:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030c90382/0x2d2e3b3f34a7b859 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.343989:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788625397.343995:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625397.344001:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030c90382/0x2d2e3b3f34a7b859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.344017:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030c90382/0x2d2e3b3f34a7b859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.344034:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030c90382/0x2d2e3b3f34a7b859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.344042:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030c90382/0x2d2e3b3f34a7b859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.344064:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625397.344077:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625397.344082:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030c90382/0x2d2e3b3f34a7b859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.344089:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625397.344093:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030c90382/0x2d2e3b3f34a7b859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.344100:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030c90382/0x2d2e3b3f34a7b859 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.344110:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030c90382/0x2d2e3b3f34a7b859 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.344117:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030c90382/0x2d2e3b3f34a7b859 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.344128:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625397.344136:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625397.344138:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788625397.347663:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.347680:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebcc5822/0x2d2e3b3f34a7b860 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.347704:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.347709:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.347717:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebcc5822/0x2d2e3b3f34a7b860 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.347737:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebcc5822/0x2d2e3b3f34a7b860 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.347747:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebcc5822/0x2d2e3b3f34a7b860 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.347755:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebcc5822/0x2d2e3b3f34a7b860 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.347787:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625397.348024:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625397.348033:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebcc5822/0x2d2e3b3f34a7b860 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.348041:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625397.348046:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebcc5822/0x2d2e3b3f34a7b860 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.348070:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebcc5822/0x2d2e3b3f34a7b860 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.348092:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebcc5822/0x2d2e3b3f34a7b860 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.348100:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebcc5822/0x2d2e3b3f34a7b860 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.348123:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.348125:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.348127:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625397.348656:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625397.348665:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7b867 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.348678:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788625397.348681:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625397.348687:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7b867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.348699:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7b867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.348709:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7b867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.348716:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7b867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.348742:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625397.349273:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625397.349284:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7b867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.349296:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625397.349309:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7b867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.349322:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7b867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.349341:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7b867 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.349350:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7b867 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.349372:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.349374:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.349376:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625397.349785:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625397.349794:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a376f74d/0x2d2e3b3f34a7b86e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.349807:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788625397.349812:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625397.349818:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a376f74d/0x2d2e3b3f34a7b86e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.349831:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a376f74d/0x2d2e3b3f34a7b86e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.349854:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a376f74d/0x2d2e3b3f34a7b86e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.349872:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a376f74d/0x2d2e3b3f34a7b86e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.349906:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788625397.351990:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625397.352006:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7b875 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.352025:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788625397.352030:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625397.352037:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7b875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.352058:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7b875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.352070:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7b875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.352080:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7b875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.352102:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788625397.353254:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625397.353268:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a376f74d/0x2d2e3b3f34a7b86e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.353283:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882045800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625397.353289:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a376f74d/0x2d2e3b3f34a7b86e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.353301:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a376f74d/0x2d2e3b3f34a7b86e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.353326:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a376f74d/0x2d2e3b3f34a7b86e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.353335:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a376f74d/0x2d2e3b3f34a7b86e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.353360:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625397.353366:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7b875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.353386:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625397.353389:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7b875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.353397:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7b875 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.353407:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7b875 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.353415:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7b875 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.353434:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.353437:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.353439:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625397.355150:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625397.355164:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7b87c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.355184:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788625397.355190:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625397.355199:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7b87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.355216:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7b87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.355227:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7b87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.355328:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7b87c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.355365:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625397.355450:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625397.355459:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7b87c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.355469:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625397.355474:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7b87c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.355495:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7b87c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.355549:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7b87c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.355557:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7b87c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.355712:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788625397.355784:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.355791:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b883 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.355800:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.355803:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.355808:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b883 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.355819:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b883 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.355828:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b883 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.355843:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b883 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.355856:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625397.355985:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625397.355991:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b883 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.356001:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625397.356004:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b883 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.356013:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.356027:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b883 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.356034:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000705cdf17/0x2d2e3b3f34a7b883 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.356049:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.356051:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.356059:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625397.357740:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625397.357753:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7b88a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.357769:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788625397.357773:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625397.357780:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7b88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.357795:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7b88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.357806:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7b88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.357815:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7b88a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.357849:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625397.358096:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625397.358105:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7b88a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.358115:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625397.358121:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7b88a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.358131:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7b88a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.358152:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7b88a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.358161:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7b88a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.358190:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.358192:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.358194:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625397.358682:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625397.358689:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7b898 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.358709:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788625397.358712:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625397.358718:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7b898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.358729:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7b898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.358738:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7b898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.358746:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7b898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.358762:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788625397.358911:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625397.358920:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008516cd39/0x2d2e3b3f34a7b891 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.358929:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788625397.358932:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625397.358935:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008516cd39/0x2d2e3b3f34a7b891 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.358947:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008516cd39/0x2d2e3b3f34a7b891 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.358955:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008516cd39/0x2d2e3b3f34a7b891 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.358961:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008516cd39/0x2d2e3b3f34a7b891 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.358970:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788625397.359096:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625397.359103:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7b898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.359117:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625397.359121:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7b898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.359130:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7b898 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.359145:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7b898 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.359153:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7b898 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.359171:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625397.359175:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008516cd39/0x2d2e3b3f34a7b891 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.359183:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625397.359186:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008516cd39/0x2d2e3b3f34a7b891 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.359193:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008516cd39/0x2d2e3b3f34a7b891 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.359203:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008516cd39/0x2d2e3b3f34a7b891 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.359216:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008516cd39/0x2d2e3b3f34a7b891 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.359231:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.359232:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.359234:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625397.359742:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625397.359749:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7b89f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.359758:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788625397.359761:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625397.359765:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7b89f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.359775:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7b89f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.359796:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7b89f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.359803:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7b89f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.359819:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625397.360127:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625397.360136:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7b89f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.360145:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625397.360149:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7b89f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.360170:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7b89f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.360186:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7b89f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.360194:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7b89f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.360216:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.360218:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.360220:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.360409:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625397.360731:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625397.360740:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7b8a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.360751:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788625397.360755:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625397.360760:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7b8a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625397.360764:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625397.360772:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7b8a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.360774:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85a6d77/0x2d2e3b3f34a7b8ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.360794:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7b8a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.360795:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788625397.360803:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625397.360815:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7b8a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.360816:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e85a6d77/0x2d2e3b3f34a7b8ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.360841:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e85a6d77/0x2d2e3b3f34a7b8ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.360866:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85a6d77/0x2d2e3b3f34a7b8ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.360883:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625397.360900:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e85a6d77/0x2d2e3b3f34a7b8ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.360917:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788625397.362589:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625397.362603:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7b8a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.362618:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625397.362624:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7b8a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.362638:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7b8a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.362663:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7b8a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.362671:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7b8a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.362694:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625397.362700:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e85a6d77/0x2d2e3b3f34a7b8ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.362714:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882044400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625397.362718:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85a6d77/0x2d2e3b3f34a7b8ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.362726:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85a6d77/0x2d2e3b3f34a7b8ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.362738:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e85a6d77/0x2d2e3b3f34a7b8ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.362745:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e85a6d77/0x2d2e3b3f34a7b8ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.362762:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.362763:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.362765:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.362778:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625397.362954:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1788625397.362955:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625397.362968:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7d7c35/0x2d2e3b3f34a7b8bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.362968:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7b8b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.362999:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788625397.363000:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788625397.363009:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625397.363009:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625397.363024:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7b8b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.363025:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7d7c35/0x2d2e3b3f34a7b8bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.363055:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7b8b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.363056:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce7d7c35/0x2d2e3b3f34a7b8bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.363083:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7b8b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.363084:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7d7c35/0x2d2e3b3f34a7b8bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.363105:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7b8b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.363106:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7d7c35/0x2d2e3b3f34a7b8bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.363385:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788625397.371694:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625397.371719:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b8c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.371744:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788625397.371750:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625397.371759:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.371778:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.371792:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.371801:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b8c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.372458:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788625397.372470:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7b8b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.372481:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625397.372502:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7b8b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.372512:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7b8b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.372562:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7b8b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.372571:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7b8b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.372602:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788625397.372608:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce7d7c35/0x2d2e3b3f34a7b8bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625397.372616:0:19755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625397.372617:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882044000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625397.372622:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7d7c35/0x2d2e3b3f34a7b8bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.372632:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7d7c35/0x2d2e3b3f34a7b8bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.372645:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce7d7c35/0x2d2e3b3f34a7b8bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.372652:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce7d7c35/0x2d2e3b3f34a7b8bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.372679:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625397.372683:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b8c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.372692:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625397.372696:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b8c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.372705:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b8c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.372716:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b8c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.372725:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625397.372728:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625397.372745:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788625397.372753:0:19755:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1788625397.372897:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17264:x1875509206252800:12345-0@lo:5:osp-pre-0-0.0 Request processed in 141718us (159015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625397.372917:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625397.372970:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788625397.372990:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17982:x1875509206253056:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788625397.373090:0:17264:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744833100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17264:1875509206252800:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788625397.373114:0:17264:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788625397.373181:0:17264:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744228700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17264:1875509206253184:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788625397.373235:0:17264:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625397.373286:0:17264:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788625397.373766:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788625397.373776:0:18747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc937957/0x2d2e3b3f34a7b8c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625397.374288:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625397.374297:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047ab009f/0x2d2e3b3f34a7b8c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.374314:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788625397.374319:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625397.374329:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047ab009f/0x2d2e3b3f34a7b8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.374346:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047ab009f/0x2d2e3b3f34a7b8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.374358:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047ab009f/0x2d2e3b3f34a7b8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.374366:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047ab009f/0x2d2e3b3f34a7b8c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.374574:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625397.375740:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625397.375758:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047ab009f/0x2d2e3b3f34a7b8c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.375772:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625397.375780:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047ab009f/0x2d2e3b3f34a7b8c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.375793:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047ab009f/0x2d2e3b3f34a7b8c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.375835:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047ab009f/0x2d2e3b3f34a7b8c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.375846:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047ab009f/0x2d2e3b3f34a7b8c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.375873:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625397.375876:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625397.376063:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625397.376074:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b8d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.376093:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788625397.376098:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625397.376108:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b8d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.376121:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b8d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.376131:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b8d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.376140:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b8d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.376341:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625397.376350:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b8d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.376368:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625397.376371:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b8d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.376379:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b8d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.376392:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b8d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625397.376459:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.376498:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.376502:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625397.376504:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625397.376608:0:18745:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788625397.376790:0:18745:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:2.0:1788625397.376833:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788625397.376841:0:18747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f640865/0x2d2e3b3f34a7b8d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625397.377776:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206253184 00002000:00010000:2.0:1788625397.377782:0:18747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1788625397.377791:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206253184 00010000:00010000:2.0:1788625397.377793:0:18747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b8d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.377810:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788625397.377815:0:18747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625397.377823:0:18747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b8d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.377856:0:18747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b8d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.377869:0:18747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b8d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625397.377878:0:18747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b8d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.377942:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625397.377949:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b8d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.377957:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625397.377962:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b8d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.377971:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b8d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.377989:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b8d7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625397.377999:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625397.378007:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625397.378009:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625397.378079:0:18747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788625397.378086:0:18747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7e33e8b/0x2d2e3b3f34a7b8d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788625397.378171:0:18747:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1788625397.378334:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17266:x1875509206252544:12345-0@lo:5:osp-pre-1-0.0 Request processed in 164812us (167199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625397.378345:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788625397.378384:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788625397.378396:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17264:x1875509206253184:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788625397.378476:0:18747:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000100:00100000:2.0:1788625397.378924:0:17266:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17266:1875509206252544:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788625397.378946:0:17266:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1788625397.379013:0:17266:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858354700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17266:1875509206253312:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788625397.379080:0:17266:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625397.379118:0:17266:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738b83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625397.379138:0:18745:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788625397.379147:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206253312 00000100:00100000:2.0:1788625397.379153:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206253312 00000100:00100000:2.0:1788625397.381743:0:19761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625397.381766:0:19761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17266:x1875509206253312:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788625397.381828:0:19761:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:0.0:1788625397.390559:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788625397.407580:0:19755:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788625397.407598:0:19755:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788625397.407773:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17982:x1875509206253056:12345-0@lo:7:osp-pre-1-1.0 Request processed in 34784us (193754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625397.407790:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000001:00080000:3.0:1788625397.408382:0:18741:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1788625397.408449:0:18741:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788625397.408462:0:17982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17982:1875509206253056:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788625397.408494:0:17982:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788625397.408625:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17264:x1875509206253184:12345-0@lo:5:osp-pre-0-0.0 Request processed in 30231us (35388us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788625397.408635:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625397.409373:0:17982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17982:1875509206253440:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788625397.409435:0:17982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625397.409481:0:17982:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788625397.409561:0:17264:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788625397.409569:0:17264:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744228700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17264:1875509206253184:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788625397.409582:0:17264:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000001:00080000:2.0:1788625397.410598:0:19558:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788625397.410652:0:19558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788625397.410657:0:19558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788625397.410901:0:19761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17266:x1875509206253312:12345-0@lo:5:osp-pre-1-0.0 Request processed in 29138us (31816us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788625397.410913:0:19761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788625397.410949:0:19761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206253440 00000100:00100000:0.0:1788625397.410959:0:19761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206253440 00000100:00100000:0.0:1788625397.411014:0:19761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788625397.411025:0:19761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:17982:x1875509206253440:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788625397.411068:0:19761:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788625397.411105:0:19761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:17982:x1875509206253440:12345-0@lo:5:osp-pre-1-1.0 Request processed in 83us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625397.411112:0:19761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788625397.411167:0:17982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17982:1875509206253440:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788625397.411184:0:17982:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788625397.411237:0:17982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17982:1875509206253568:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788625397.411310:0:17982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625397.411335:0:17982:0:(client.c:2716:ptlrpc_set_wait()) set ffff99884537d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788625397.411627:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206253568 00000100:00100000:3.0:1788625397.411634:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206253568 00000100:00100000:3.0:1788625397.411673:0:18745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788625397.411682:0:18745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17982:x1875509206253568:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788625397.411731:0:18745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00100000:2.0:1788625397.411863:0:17266:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788625397.411873:0:17266:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858354700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17266:1875509206253312:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788625397.411885:0:17266:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:2.0:1788625397.446711:0:18745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17982:x1875509206253568:12345-0@lo:5:osp-pre-1-1.0 Request processed in 35019us (35389us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788625397.446730:0:18745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625397.447993:0:17982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17982:1875509206253568:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788625397.448019:0:17982:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788625397.448379:0:17982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858354700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17982:1875509206253696:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788625397.448463:0:17982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625397.448533:0:17982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738b8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788625397.448970:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206253696 00000100:00100000:0.0:1788625397.448979:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206253696 00000100:00100000:0.0:1788625397.449099:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625397.449111:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17982:x1875509206253696:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788625397.449194:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17982:x1875509206253696:12345-0@lo:900:osp-pre-1-1.0 Request processed in 84us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625397.449203:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788625397.449779:0:17982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998858354700 x1875509206253696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788625413 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625397.449807:0:17982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858354700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17982:1875509206253696:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1788625398.160677:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625399.180876:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625400.076909:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206253824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625400.076993:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625400.077282:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625400.077554:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206253952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625400.077589:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625400.077632:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206253824 00000100:00100000:2.0:1788625400.077639:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206253824 00000100:00100000:2.0:1788625400.077696:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788625400.077706:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206253824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788625400.077739:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788625400.077784:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206253824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625400.077791:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788625400.077813:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625400.077857:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206253824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788625400.078609:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206253952 00000100:00100000:1.0:1788625400.078616:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206253952 00000100:00100000:1.0:1788625400.078660:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788625400.078675:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206253952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625400.078705:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788625400.079040:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206253952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 366us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625400.079048:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788625400.079261:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206253952:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1788625400.121977:0:19915:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788625400.207733:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625400.588566:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625400.588594:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206254080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625400.588688:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625400.589694:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206254080 00000100:00100000:0.0:1788625400.589707:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206254080 00000100:00100000:0.0:1788625400.590246:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788625400.590259:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206254080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625400.590870:0:17978:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788625400.591235:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206254080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 977us (2543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625400.591246:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788625400.597540:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206254080:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788625401.118646:0:19968:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788625401.118924:0:19968:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788625401.235094:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788625402.230478:0:20018:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788625402.230783:0:20018:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788625402.252080:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625402.564125:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625402.564224:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185201792 00000100:00100000:0.0:1788625402.564238:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185201792 00000100:00100000:0.0:1788625402.564296:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 114 00000100:00100000:0.0:1788625402.564305:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2390:x1875509185201792:12345-192.168.204.14@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788625402.564350:0:17234:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from dd7b606b-b43c-4a41-a068-dadb9e3a4424@192.168.204.14@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:0.0:1788625402.564390:0:17234:0:(genops.c:1385:class_connect()) connect: client dd7b606b-b43c-4a41-a068-dadb9e3a4424, cookie 0x2d2e3b3f34a7b8de 00000100:00080000:0.0:1788625402.564576:0:17234:0:(import.c:65:import_set_state_nolock()) ffff99874352e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625402.564643:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+5:2390:x1875509185201792:12345-192.168.204.14@tcp:250:mount.lustre.0 Request processed in 337us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.564651:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 114 00000100:00100000:2.0:1788625402.574856:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625402.574966:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185201920 00000100:00100000:0.0:1788625402.574976:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185201920 00000100:00100000:0.0:1788625402.575044:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 115 00000100:00100000:0.0:1788625402.575054:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+5:14923:x1875509185201920:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788625402.575073:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625402.575096:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998882171c00/0x2d2e3b3f34a7b8e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e457 expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625402.575130:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998882171c00/0x2d2e3b3f34a7b8e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e457 expref: 6 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625402.575142:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998882171c00/0x2d2e3b3f34a7b8e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e457 expref: 6 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625402.575151:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882171c00, rc 0) 00000100:00100000:0.0:1788625402.575215:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+6:14923:x1875509185201920:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 163us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.575222:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 115 00000100:00100000:1.0:1788625402.589703:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625402.589950:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185202048 00000100:00100000:3.0:1788625402.589961:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185202048 00000100:00100000:3.0:1788625402.590032:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 116 00000100:00100000:3.0:1788625402.590044:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+6:14923:x1875509185202048:12345-192.168.204.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788625402.590194:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+6:14923:x1875509185202048:12345-192.168.204.14@tcp:501:mount.lustre.0 Request processed in 152us (500us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788625402.590202:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 116 00000100:00100000:2.0:1788625402.603938:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625402.607988:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185202176 00000100:00100000:0.0:1788625402.608005:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185202176 00000100:00100000:0.0:1788625402.608387:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 117 00000100:00100000:0.0:1788625402.608418:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+6:14923:x1875509185202176:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788625402.608436:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625402.608458:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998882171800/0x2d2e3b3f34a7b8ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e45e expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625402.608491:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998882171800/0x2d2e3b3f34a7b8ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e45e expref: 7 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625402.608503:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998882171800/0x2d2e3b3f34a7b8ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e45e expref: 7 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625402.608513:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882171800, rc 0) 00000100:00100000:0.0:1788625402.608977:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+7:14923:x1875509185202176:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 561us (5114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.608985:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 117 00000100:00100000:2.0:1788625402.623968:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625402.624182:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185202304 00000100:00100000:0.0:1788625402.624194:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185202304 00000100:00100000:0.0:1788625402.624256:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 118 00000100:00100000:0.0:1788625402.624266:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+7:14923:x1875509185202304:12345-192.168.204.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788625402.624466:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+8:14923:x1875509185202304:12345-192.168.204.14@tcp:501:mount.lustre.0 Request processed in 201us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.624475:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 118 00000100:00100000:1.0:1788625402.628851:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625402.629040:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185202432 00000100:00100000:0.0:1788625402.629054:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185202432 00000100:00100000:0.0:1788625402.629143:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 119 00000100:00100000:0.0:1788625402.629153:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+8:14923:x1875509185202432:12345-192.168.204.14@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788625402.630258:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+8:14923:x1875509185202432:12345-192.168.204.14@tcp:503:mount.lustre.0 Request processed in 1099us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.630282:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 119 00000100:00100000:0.0:1788625402.635855:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206254464:0@lo:400:kworker.0 00000100:00100000:0.0:1788625402.635944:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625402.636001:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206254976:0@lo:400:kworker.0 00000100:00100000:0.0:1788625402.636023:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625402.636038:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206255488:0@lo:400:kworker.0 00000100:00100000:0.0:1788625402.636061:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625402.636278:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788625402.636286:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206254336:0@lo:400:kworker.0 00000100:00100000:0.0:1788625402.636310:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625402.636336:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206254848:0@lo:400:kworker.0 00000100:00100000:0.0:1788625402.636354:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625402.636370:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206255360:0@lo:400:kworker.0 00000100:00100000:0.0:1788625402.636401:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625402.636432:0:19761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206254464 00000100:00100000:0.0:1788625402.636440:0:19761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206254464 00000100:00100000:0.0:1788625402.636506:0:19761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206254976 00000100:00100000:0.0:1788625402.636509:0:19761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206254976 00000100:00100000:0.0:1788625402.636551:0:19761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625402.636559:0:19761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206254464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625402.636611:0:19761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206254464:12345-0@lo:400:kworker.0 Request processed in 52us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.636617:0:19761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625402.636633:0:19761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625402.636639:0:19761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206254976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625402.636680:0:19761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206254976:12345-0@lo:400:kworker.0 Request processed in 42us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.636686:0:19761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625402.636703:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206255488 00000100:00100000:0.0:1788625402.636706:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206255488 00000100:00100000:0.0:1788625402.637009:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206255360 00000100:00100000:0.0:1788625402.637013:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206255360 00000100:00100000:0.0:1788625402.637036:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788625402.637043:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206255488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625402.637297:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206255488:12345-0@lo:400:kworker.0 Request processed in 254us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.637304:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788625402.637318:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788625402.637325:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206255360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625402.637352:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206255360:12345-0@lo:400:kworker.0 Request processed in 29us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.637359:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788625402.637394:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206254336 00000100:00100000:0.0:1788625402.637398:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206254336 00000100:00100000:0.0:1788625402.637430:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206254848 00000100:00100000:0.0:1788625402.637433:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206254848 00000100:00100000:1.0:1788625402.638809:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788625402.638828:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206254336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625402.638914:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206254336:12345-0@lo:400:kworker.0 Request processed in 95us (2603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625402.638922:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788625402.639302:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3638:1875509206254208:0@lo:400:kworker.0 00000100:00100000:2.0:1788625402.639354:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625402.639412:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206254720:0@lo:400:kworker.0 00000100:00100000:2.0:1788625402.639482:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625402.639507:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206255232:0@lo:400:kworker.0 00000100:00100000:2.0:1788625402.639547:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625402.640062:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788625402.640207:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206254848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625402.640261:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206254848:12345-0@lo:400:kworker.0 Request processed in 192us (3905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.640268:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788625402.640304:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206254720 00000100:00100000:0.0:1788625402.640319:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206254720 00000100:00100000:0.0:1788625402.640340:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206255232 00000100:00100000:0.0:1788625402.640343:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206255232 00000100:00100000:0.0:1788625402.640355:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788625402.640360:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206254720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625402.640401:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206254720:12345-0@lo:400:kworker.0 Request processed in 41us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.640407:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788625402.640418:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788625402.640424:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206255232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625402.640655:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206255744:0@lo:400:kworker.0 00000100:00100000:1.0:1788625402.640777:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206255872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625402.641086:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206254592:0@lo:400:kworker.0 00000100:00100000:2.0:1788625402.641213:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788625402.641256:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744228e00 x1875509206254720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625402.641269:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206254720:0@lo:400:kworker.0 00000100:00100000:2.0:1788625402.641309:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206255744 00000100:00100000:2.0:1788625402.641313:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206255744 00000100:00100000:2.0:1788625402.641343:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788625402.641350:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206255744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625402.641397:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206255744:12345-0@lo:400:kworker.0 Request processed in 47us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625402.641403:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788625402.641466:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99874422bb80 x1875509206255744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625402.641475:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206255744:0@lo:400:kworker.0 00000100:00100000:2.0:1788625402.641557:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206254208 00000100:00100000:2.0:1788625402.641562:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206254208 00000100:00100000:2.0:1788625402.641589:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788625402.641595:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3638:x1875509206254208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625402.641630:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3638:x1875509206254208:12345-0@lo:400:kworker.0 Request processed in 35us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625402.641647:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788625402.641683:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3638:1875509206254208:0@lo:400:kworker.0 00000100:00100000:1.0:1788625402.641868:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625402.641915:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625402.641924:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206256000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625402.641946:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625402.641975:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206255872 00000100:00100000:1.0:1788625402.641978:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206255872 00000100:00100000:1.0:1788625402.641998:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206256000 00000100:00100000:1.0:1788625402.642001:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206256000 00000100:00100000:1.0:1788625402.642012:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625402.642018:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1875509206255872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788625402.642043:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788625402.642260:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1875509206255872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 240us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625402.642267:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625402.642281:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625402.642287:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206256000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625402.642301:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788625402.642327:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206256000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625402.642332:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625402.642430:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206256000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625402.642454:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206255872:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788625402.644186:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625402.644197:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625402.644200:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625402.644202:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625402.644252:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206254336:0@lo:400:kworker.0 00000100:00100000:1.0:1788625402.644267:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206254848:0@lo:400:kworker.0 00010000:00080000:1.0:1788625402.644284:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744228380 x1875509206255360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625402.644313:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206255360:0@lo:400:kworker.0 00000100:00100000:1.0:1788625402.644328:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206254464:0@lo:400:kworker.0 00000100:00100000:1.0:1788625402.644340:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206254976:0@lo:400:kworker.0 00010000:00080000:1.0:1788625402.644351:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744229500 x1875509206255488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625402.644359:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206255488:0@lo:400:kworker.0 00000100:00100000:2.0:1788625402.645629:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625402.645646:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206256128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625402.645713:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625402.647313:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206256128 00000100:00100000:2.0:1788625402.647326:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206256128 00000100:00100000:2.0:1788625402.647400:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788625402.647409:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206256128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788625402.647433:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788625402.647498:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206256128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625402.647505:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788625402.647637:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625402.647686:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206256128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625402.647712:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185202560 00000100:00100000:2.0:1788625402.647715:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185202560 00000100:00100000:0.0:1788625402.647842:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206255232:12345-0@lo:400:kworker.0 Request processed in 7416us (8292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.647852:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788625402.649283:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 121 00000100:00100000:2.0:1788625402.649297:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+8:14941:x1875509185202560:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788625402.649492:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+8:14941:x1875509185202560:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 199us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625402.649510:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 121 00010000:00080000:2.0:1788625402.649722:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744228000 x1875509206255232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788625402.649993:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625402.652727:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206255232:0@lo:400:kworker.0 00000001:00080000:2.0:1788625402.653548:0:19558:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:3.0:1788625402.654198:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625402.654257:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206255104:0@lo:400:kworker.0 00000100:00100000:3.0:1788625402.654296:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625402.654323:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206255616:0@lo:400:kworker.0 00000100:00100000:3.0:1788625402.654348:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625402.654837:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206254592 00000100:00100000:2.0:1788625402.654848:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206254592 00000100:00100000:2.0:1788625402.654911:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206255104 00000100:00100000:2.0:1788625402.654914:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206255104 00000100:00100000:2.0:1788625402.654937:0:18745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788625402.654946:0:18745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206254592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625402.655006:0:18745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206254592:12345-0@lo:400:kworker.0 Request processed in 61us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625402.655014:0:18745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788625402.655029:0:18745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788625402.655036:0:18745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206255104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625402.655062:0:18745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206255104:12345-0@lo:400:kworker.0 Request processed in 27us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625402.655080:0:18745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625402.655332:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206254592:0@lo:400:kworker.0 00000100:00100000:3.0:1788625402.655342:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788625402.655357:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206255104:0@lo:400:kworker.0 00000100:00100000:1.0:1788625402.667343:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206255616 00000100:00100000:1.0:1788625402.667360:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206255616 00000100:00100000:1.0:1788625402.668260:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788625402.668274:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206255616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625402.668397:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206255616:12345-0@lo:400:kworker.0 Request processed in 128us (14048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625402.668406:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788625402.668476:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788625402.671247:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744228a80 x1875509206255616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625402.671268:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206255616:0@lo:400:kworker.0 00000100:00100000:2.0:1788625402.710650:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625402.710760:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185202688 00000100:00100000:0.0:1788625402.710772:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185202688 00000100:00100000:0.0:1788625402.710834:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 122 00000100:00100000:0.0:1788625402.710844:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+8:14941:x1875509185202688:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625402.711010:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+8:14941:x1875509185202688:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 167us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.711019:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 122 00000100:00100000:2.0:1788625402.724134:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625402.725090:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185202816 00000100:00100000:0.0:1788625402.725107:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185202816 00000100:00100000:0.0:1788625402.725178:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 123 00000100:00100000:0.0:1788625402.725191:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+8:14941:x1875509185202816:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625402.725406:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+8:14941:x1875509185202816:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 217us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.725426:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 123 00000100:00100000:3.0:1788625402.738388:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625402.738551:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185202944 00000100:00100000:2.0:1788625402.738563:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185202944 00000100:00100000:2.0:1788625402.738636:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 124 00000100:00100000:2.0:1788625402.738648:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860803050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+8:14923:x1875509185202944:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788625402.738672:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625402.738693:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998744189c00/0x2d2e3b3f34a7b8f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e48f expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625402.738732:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998744189c00/0x2d2e3b3f34a7b8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e48f expref: 9 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625402.738745:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998744189c00/0x2d2e3b3f34a7b8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e48f expref: 9 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625402.738755:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744189c00, rc 0) 00000100:00100000:2.0:1788625402.738830:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860803050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+9:14923:x1875509185202944:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 185us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625402.738838:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 124 00000100:00100000:3.0:1788625402.744977:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625402.745093:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185203072 00000100:00100000:2.0:1788625402.745103:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185203072 00000100:00100000:2.0:1788625402.745165:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 125 00000100:00100000:2.0:1788625402.745175:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+9:14923:x1875509185203072:12345-192.168.204.14@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788625402.745202:0:17232:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788625402.745229:0:17232:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788625402.745234:0:17232:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788625402.745243:0:17232:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788625402.745246:0:17232:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788625402.745248:0:17232:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788625402.751306:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+9:14923:x1875509185203072:12345-192.168.204.14@tcp:256:mount.lustre.0 Request processed in 6115us (6320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625402.751324:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 125 00000100:00100000:1.0:1788625402.754430:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625402.754895:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185203200 00000100:00100000:0.0:1788625402.754908:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185203200 00000100:00100000:0.0:1788625402.754975:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 126 00000100:00100000:0.0:1788625402.754986:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860801c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+9:14923:x1875509185203200:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788625402.755003:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625402.755022:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998882171a00/0x2d2e3b3f34a7b8fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e496 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625402.755052:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998882171a00/0x2d2e3b3f34a7b8fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e496 expref: 10 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625402.755064:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998882171a00/0x2d2e3b3f34a7b8fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e496 expref: 10 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625402.755074:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882171a00, rc 0) 00000100:00100000:0.0:1788625402.755179:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860801c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+10:14923:x1875509185203200:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 195us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.755187:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 126 00000100:00100000:2.0:1788625402.758962:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625402.759037:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185203328 00000100:00100000:0.0:1788625402.759048:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185203328 00000100:00100000:0.0:1788625402.759113:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 127 00000100:00100000:0.0:1788625402.759125:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+10:14923:x1875509185203328:12345-192.168.204.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788625402.759394:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+10:14923:x1875509185203328:12345-192.168.204.14@tcp:501:mount.lustre.0 Request processed in 271us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.759402:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 127 00000100:00100000:0.0:1788625402.763809:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625402.763911:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185203456 00000100:00100000:2.0:1788625402.763922:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185203456 00000100:00100000:2.0:1788625402.763980:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 128 00000100:00100000:2.0:1788625402.763991:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+10:14923:x1875509185203456:12345-192.168.204.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788625402.764162:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+10:14923:x1875509185203456:12345-192.168.204.14@tcp:503:mount.lustre.0 Request processed in 172us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625402.764170:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 128 00000100:00100000:1.0:1788625402.768179:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625402.768957:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185203584 00000100:00100000:0.0:1788625402.768967:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185203584 00000100:00100000:0.0:1788625402.769083:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 129 00000100:00100000:0.0:1788625402.769093:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+10:14947:x1875509185203584:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625402.769330:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+10:14947:x1875509185203584:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 238us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.769338:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 129 00000100:00100000:3.0:1788625402.779307:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625402.779503:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185203712 00000100:00100000:0.0:1788625402.779554:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185203712 00000100:00100000:0.0:1788625402.779627:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 130 00000100:00100000:0.0:1788625402.779638:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+10:14947:x1875509185203712:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625402.779812:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+10:14947:x1875509185203712:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 174us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.779821:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 130 00000100:00100000:1.0:1788625402.801119:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625402.801220:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625402.801605:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185203840 00000100:00100000:0.0:1788625402.801616:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185203840 00000100:00100000:0.0:1788625402.801664:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185204096 00000100:00100000:0.0:1788625402.801667:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185204096 00000100:00100000:0.0:1788625402.801688:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:0.0:1788625402.801697:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1875509185203840:12345-192.168.204.14@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788625402.801734:0:17239:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2577c14b-df6c-4b8f-a20a-0ae385000d2e@192.168.204.14@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:0.0:1788625402.801800:0:17239:0:(genops.c:1385:class_connect()) connect: client 2577c14b-df6c-4b8f-a20a-0ae385000d2e, cookie 0x2d2e3b3f34a7b901 00000004:00100000:0.0:1788625402.801828:0:17239:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788625402.802108:0:17239:0:(import.c:65:import_set_state_nolock()) ffff998743528000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625402.802186:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2390:x1875509185203840:12345-192.168.204.14@tcp:38:mount.lustre.0 Request processed in 487us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.802199:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:0.0:1788625402.802220:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00100000:0.0:1788625402.802225:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1875509185204096:12345-192.168.204.14@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788625402.802242:0:17239:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 2577c14b-df6c-4b8f-a20a-0ae385000d2e@192.168.204.14@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:0.0:1788625402.802278:0:17239:0:(genops.c:1385:class_connect()) connect: client 2577c14b-df6c-4b8f-a20a-0ae385000d2e, cookie 0x2d2e3b3f34a7b908 00000004:00100000:0.0:1788625402.802293:0:17239:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788625402.804326:0:17239:0:(import.c:65:import_set_state_nolock()) ffff998872643000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625402.804423:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2390:x1875509185204096:12345-192.168.204.14@tcp:38:mount.lustre.0 Request processed in 2191us (3198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.804435:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00100000:1.0:1788625402.820742:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625402.820785:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625402.820815:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625402.820904:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185204352 00000100:00100000:3.0:1788625402.820915:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185204352 00000100:00100000:3.0:1788625402.820996:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185204224 00000100:00100000:3.0:1788625402.820999:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185204224 00000100:00100000:3.0:1788625402.821015:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185203968 00000100:00100000:3.0:1788625402.821017:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185203968 00000100:00100000:3.0:1788625402.821032:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:3.0:1788625402.821044:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:14923:x1875509185204352:12345-192.168.204.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788625402.821101:0:17241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788625402.821189:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:14923:x1875509185204352:12345-192.168.204.14@tcp:41:mount.lustre.0 Request processed in 147us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625402.821197:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:3.0:1788625402.821218:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:3.0:1788625402.821225:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:0:x1875509185204224:12345-192.168.204.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788625402.821244:0:17241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788625402.821280:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:0:x1875509185204224:12345-192.168.204.14@tcp:41:mount.lustre.0 Request processed in 56us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625402.821286:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:3.0:1788625402.821298:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00100000:3.0:1788625402.821303:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:0:x1875509185203968:12345-192.168.204.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788625402.821312:0:17241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788625402.821332:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:0:x1875509185203968:12345-192.168.204.14@tcp:41:mount.lustre.0 Request processed in 28us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625402.821338:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00080000:1.0:1788625402.821618:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625402.821623:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625402.825441:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625402.825616:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185204480 00000100:00100000:3.0:1788625402.825628:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185204480 00000100:00100000:3.0:1788625402.825700:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00100000:3.0:1788625402.825712:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:14923:x1875509185204480:12345-192.168.204.14@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788625402.825833:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:14923:x1875509185204480:12345-192.168.204.14@tcp:40:mount.lustre.0 Request processed in 123us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625402.825841:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00100000:3.0:1788625402.834742:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625402.834793:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625402.834827:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625402.834918:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185204608 00000100:00100000:2.0:1788625402.834929:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185204608 00000100:00100000:2.0:1788625402.834974:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185204736 00000100:00100000:2.0:1788625402.834977:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185204736 00000100:00100000:2.0:1788625402.835000:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:2.0:1788625402.835008:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875509185204608:12345-192.168.204.14@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788625402.835045:0:18747:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2577c14b-df6c-4b8f-a20a-0ae385000d2e@192.168.204.14@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1788625402.835088:0:18747:0:(genops.c:1385:class_connect()) connect: client 2577c14b-df6c-4b8f-a20a-0ae385000d2e, cookie 0x2d2e3b3f34a7b90f 00002000:00100000:2.0:1788625402.835100:0:18747:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2577c14b-df6c-4b8f-a20a-0ae385000d2e/ffff998845920000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788625402.835112:0:18747:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788625402.835313:0:18747:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788625402.835346:0:18747:0:(import.c:65:import_set_state_nolock()) ffff998845926800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625402.835429:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2390:x1875509185204608:12345-192.168.204.14@tcp:8:mount.lustre.0 Request processed in 420us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625402.835447:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:2.0:1788625402.835672:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:2.0:1788625402.835678:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875509185204736:12345-192.168.204.14@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788625402.835696:0:18747:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2577c14b-df6c-4b8f-a20a-0ae385000d2e@192.168.204.14@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1788625402.835716:0:18747:0:(genops.c:1385:class_connect()) connect: client 2577c14b-df6c-4b8f-a20a-0ae385000d2e, cookie 0x2d2e3b3f34a7b916 00002000:00100000:2.0:1788625402.835722:0:18747:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2577c14b-df6c-4b8f-a20a-0ae385000d2e/ffff998845926000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788625402.835727:0:18747:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788625402.835830:0:18747:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788625402.835844:0:18747:0:(import.c:65:import_set_state_nolock()) ffff998845920800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625402.835867:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2390:x1875509185204736:12345-192.168.204.14@tcp:8:mount.lustre.0 Request processed in 188us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625402.835873:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:1.0:1788625402.836786:0:17250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185204864 00000100:00100000:1.0:1788625402.836796:0:17250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185204864 00000100:00100000:1.0:1788625402.836852:0:17250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:1.0:1788625402.836861:0:17250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:14923:x1875509185204864:12345-192.168.204.14@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788625402.836924:0:17250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:14923:x1875509185204864:12345-192.168.204.14@tcp:900:mount.lustre.0 Request processed in 63us (2466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625402.836931:0:17250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:3.0:1788625402.845998:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625402.846471:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185204992 00000100:00100000:1.0:1788625402.846482:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185204992 00000100:00100000:1.0:1788625402.846588:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:1.0:1788625402.846600:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:14923:x1875509185204992:12345-192.168.204.14@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788625402.856345:0:17242:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9643us 00000004:00200000:0.0:1788625402.878828:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788625402.878982:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:14923:x1875509185204992:12345-192.168.204.14@tcp:33:mount.lustre.0 Request processed in 32379us (32991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625402.878998:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:0.0:1788625403.209860:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625403.209968:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185205120 00000100:00100000:1.0:1788625403.209979:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185205120 00000100:00100000:1.0:1788625403.210056:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 13 00000100:00100000:1.0:1788625403.210068:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:14970:x1875509185205120:12345-192.168.204.14@tcp:101:mkdir.0 00010000:00010000:1.0:1788625403.210092:0:18690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625403.210122:0:18690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882044000/0x2d2e3b3f34a7b91d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e4c7 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625403.210199:0:18690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7b924 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625403.210226:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7b924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625403.210243:0:18690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7b924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625403.210310:0:18690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788625403.210314:0:18690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625403.210354:0:18690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7b924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625403.210411:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882044000/0x2d2e3b3f34a7b91d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e4c7 expref: 8 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625403.210435:0:18690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7b924 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e4c7 expref: 7 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625403.210445:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99874244ad00) 00010000:00010000:1.0:1788625403.210448:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625403.210452:0:18690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882045800, rc 0) 00000100:00100000:1.0:1788625403.210585:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:14970:x1875509185205120:12345-192.168.204.14@tcp:101:mkdir.0 Request processed in 520us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625403.210595:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 13 00010000:00010000:0.0:1788625403.275983:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788625403.678823:0:18741:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2577c14b-df6c-4b8f-a20a-0ae385000d2e 00010000:00010000:0.0:1788625404.299776:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625404.748353:0:17273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788625405.195835:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206256256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625405.195937:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625405.195976:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625405.195990:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206256256 00000100:00100000:1.0:1788625405.195997:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206256384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625405.196003:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206256256 00000100:00100000:1.0:1788625405.196046:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625405.196084:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206256384 00000100:00100000:1.0:1788625405.196088:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206256384 00000100:00100000:1.0:1788625405.196126:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625405.196135:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206256384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788625405.196167:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1788625405.196193:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625405.196224:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206256384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625405.196254:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788625405.196282:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206256384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625405.196424:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788625405.196435:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206256256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788625405.196467:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788625405.196547:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206256256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625405.196565:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788625405.196688:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206256256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625405.286086:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625405.286159:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185205248 00000100:00100000:1.0:1788625405.286171:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185205248 00000100:00100000:1.0:1788625405.286254:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00100000:1.0:1788625405.286266:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:15022:x1875509185205248:12345-192.168.204.14@tcp:41:lfs.0 00000100:00080000:2.0:1788625405.286281:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1788625405.286302:0:17241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788625405.286440:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:15022:x1875509185205248:12345-192.168.204.14@tcp:41:lfs.0 Request processed in 176us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625405.286448:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00100000:3.0:1788625405.292210:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625405.292368:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185205376 00000100:00100000:1.0:1788625405.292381:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185205376 00000100:00100000:1.0:1788625405.292477:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00100000:1.0:1788625405.292490:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:15022:x1875509185205376:12345-192.168.204.14@tcp:41:lfs.0 00000004:00000024:1.0:1788625405.292565:0:18690:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788625405.292687:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:15022:x1875509185205376:12345-192.168.204.14@tcp:41:lfs.0 Request processed in 199us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625405.292695:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00080000:2.0:1788625405.293097:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788625405.296904:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625405.297020:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185205504 00000100:00100000:0.0:1788625405.297033:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185205504 00000100:00100000:0.0:1788625405.297120:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:0.0:1788625405.297131:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:15022:x1875509185205504:12345-192.168.204.14@tcp:13:lfs.0 00002000:00000024:0.0:1788625405.297166:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788625405.297302:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:15022:x1875509185205504:12345-192.168.204.14@tcp:13:lfs.0 Request processed in 172us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625405.297310:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00080000:2.0:1788625405.297494:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625405.304981:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625405.305133:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185205632 00000100:00100000:2.0:1788625405.305146:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185205632 00000100:00100000:2.0:1788625405.305235:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00100000:2.0:1788625405.305248:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:15022:x1875509185205632:12345-192.168.204.14@tcp:13:lfs.0 00002000:00000024:2.0:1788625405.305289:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788625405.305387:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:15022:x1875509185205632:12345-192.168.204.14@tcp:13:lfs.0 Request processed in 142us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625405.305400:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00080000:1.0:1788625405.305546:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788625405.324507:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625405.563840:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625405.564054:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185205760 00000100:00100000:0.0:1788625405.564065:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185205760 00000100:00100000:0.0:1788625405.564190:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 131 00000100:00100000:0.0:1788625405.564201:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+10:15053:x1875509185205760:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788625405.564220:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625405.564251:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998882171200/0x2d2e3b3f34a7b92b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e4ce expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625405.564282:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998882171200/0x2d2e3b3f34a7b92b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e4ce expref: 11 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625405.564295:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998882171200/0x2d2e3b3f34a7b92b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e4ce expref: 11 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625405.564304:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882171200, rc 0) 00000100:00100000:0.0:1788625405.564384:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:15053:x1875509185205760:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 185us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625405.566051:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 131 00000100:00100000:0.0:1788625405.572640:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625405.572805:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185205888 00000100:00100000:2.0:1788625405.572816:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185205888 00000100:00100000:2.0:1788625405.572880:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 132 00000100:00100000:2.0:1788625405.572892:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:15053:x1875509185205888:12345-192.168.204.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788625405.573133:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:15053:x1875509185205888:12345-192.168.204.14@tcp:501:mount.lustre.0 Request processed in 243us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625405.573141:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 132 00000100:00100000:1.0:1788625405.588843:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625405.589044:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185206016 00000100:00100000:0.0:1788625405.589054:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185206016 00000100:00100000:0.0:1788625405.589122:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 133 00000100:00100000:0.0:1788625405.589133:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:15053:x1875509185206016:12345-192.168.204.14@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788625405.589301:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:15053:x1875509185206016:12345-192.168.204.14@tcp:503:mount.lustre.0 Request processed in 168us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625405.589309:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 133 00000100:00100000:3.0:1788625405.598434:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625405.599154:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185206144 00000100:00100000:0.0:1788625405.599169:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185206144 00000100:00100000:0.0:1788625405.599243:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 134 00000100:00100000:0.0:1788625405.599255:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:15060:x1875509185206144:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625405.600060:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:15060:x1875509185206144:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 804us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625405.600081:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 134 00000100:00100000:1.0:1788625405.680885:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625405.680990:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185206272 00000100:00100000:2.0:1788625405.681002:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185206272 00000100:00100000:2.0:1788625405.681177:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 135 00000100:00100000:2.0:1788625405.681193:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:15060:x1875509185206272:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788625405.681390:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:15060:x1875509185206272:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 192us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625405.688404:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 135 00000100:00100000:1.0:1788625405.689218:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625405.689309:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185206400 00000100:00100000:0.0:1788625405.689330:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185206400 00000100:00100000:0.0:1788625405.689391:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 136 00000100:00100000:0.0:1788625405.689401:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:15060:x1875509185206400:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625405.691043:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:15060:x1875509185206400:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 1631us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625405.691058:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 136 00000100:00100000:3.0:1788625405.699275:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625405.705327:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185206528 00000100:00100000:2.0:1788625405.705346:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185206528 00000100:00100000:2.0:1788625405.706114:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 137 00000100:00100000:2.0:1788625405.706128:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:15053:x1875509185206528:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788625405.706148:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625405.706172:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b932 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e4ff expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625405.706211:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e4ff expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625405.706226:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e4ff expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625405.706262:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188000, rc 0) 00000100:00100000:2.0:1788625405.706360:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+12:15053:x1875509185206528:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 235us (7098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625405.706368:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 137 00000100:00100000:1.0:1788625405.708212:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206256512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625405.708288:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625405.708408:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206256512 00000100:00100000:0.0:1788625405.708428:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206256512 00000100:00100000:0.0:1788625405.708482:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788625405.708491:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206256512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625405.708567:0:17978:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788625405.708618:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206256512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625405.708625:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788625405.709000:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206256512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625405.717357:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625405.718175:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185206656 00000100:00100000:0.0:1788625405.718189:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185206656 00000100:00100000:0.0:1788625405.718276:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 138 00000100:00100000:0.0:1788625405.718289:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+12:15053:x1875509185206656:12345-192.168.204.14@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788625405.718333:0:17234:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788625405.718365:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788625405.718370:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788625405.718373:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788625405.718388:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788625405.718391:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788625405.720379:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+12:15053:x1875509185206656:12345-192.168.204.14@tcp:256:mount.lustre.0 Request processed in 2080us (3858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625405.720399:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 138 00000100:00100000:3.0:1788625405.725002:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625405.725295:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185206784 00000100:00100000:2.0:1788625405.725308:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185206784 00000100:00100000:2.0:1788625405.725832:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 139 00000100:00100000:2.0:1788625405.725848:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+12:15053:x1875509185206784:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788625405.725868:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625405.725893:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998744189a00/0x2d2e3b3f34a7b939 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e506 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625405.725931:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998744189a00/0x2d2e3b3f34a7b939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e506 expref: 13 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625405.726020:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998744189a00/0x2d2e3b3f34a7b939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e506 expref: 13 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625405.726033:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744189a00, rc 0) 00000100:00100000:2.0:1788625405.726252:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:15053:x1875509185206784:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 407us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625405.726259:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 139 00000100:00100000:1.0:1788625405.730576:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625405.730780:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185206912 00000100:00100000:0.0:1788625405.730793:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185206912 00000100:00100000:0.0:1788625405.730873:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 140 00000100:00100000:0.0:1788625405.730883:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:15053:x1875509185206912:12345-192.168.204.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788625405.731061:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:15053:x1875509185206912:12345-192.168.204.14@tcp:501:mount.lustre.0 Request processed in 178us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625405.731069:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 140 00000100:00100000:1.0:1788625405.734783:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625405.734879:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185207040 00000100:00100000:2.0:1788625405.734890:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185207040 00000100:00100000:2.0:1788625405.735044:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 141 00000100:00100000:2.0:1788625405.735197:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:15053:x1875509185207040:12345-192.168.204.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788625405.735387:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:15053:x1875509185207040:12345-192.168.204.14@tcp:503:mount.lustre.0 Request processed in 323us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625405.735395:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 141 00000100:00100000:3.0:1788625405.738975:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625405.739277:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185207168 00000100:00100000:0.0:1788625405.739287:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185207168 00000100:00100000:0.0:1788625405.739362:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 142 00000100:00100000:0.0:1788625405.739378:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:15067:x1875509185207168:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625405.739605:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:15067:x1875509185207168:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 232us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625405.739614:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 142 00000100:00100000:1.0:1788625405.743501:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625405.744932:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185207296 00000100:00100000:0.0:1788625405.744961:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185207296 00000100:00100000:0.0:1788625405.745040:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 143 00000100:00100000:0.0:1788625405.745063:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:15067:x1875509185207296:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625405.745281:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:15067:x1875509185207296:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 230us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625405.745290:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 143 00000100:00100000:1.0:1788625405.760112:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625405.760466:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185207424 00000100:00100000:3.0:1788625405.760481:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185207424 00000100:00100000:0.0:1788625405.760673:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:0.0:1788625405.760685:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1875509185207424:12345-192.168.204.14@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788625405.760730:0:17239:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3eda7774-83ed-48ae-a4ab-ef06595559f2@192.168.204.14@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:0.0:1788625405.760792:0:17239:0:(genops.c:1385:class_connect()) connect: client 3eda7774-83ed-48ae-a4ab-ef06595559f2, cookie 0x2d2e3b3f34a7b940 00000004:00100000:0.0:1788625405.760826:0:17239:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788625405.760985:0:17239:0:(import.c:65:import_set_state_nolock()) ffff998872640800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625405.761259:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2390:x1875509185207424:12345-192.168.204.14@tcp:38:mount.lustre.0 Request processed in 573us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625405.761268:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:3.0:1788625405.772586:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625405.773618:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185207680 00000100:00100000:1.0:1788625405.773632:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185207680 00000100:00100000:1.0:1788625405.773701:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:1.0:1788625405.773711:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1875509185207680:12345-192.168.204.14@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788625405.773752:0:18690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 3eda7774-83ed-48ae-a4ab-ef06595559f2@192.168.204.14@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:1.0:1788625405.773808:0:18690:0:(genops.c:1385:class_connect()) connect: client 3eda7774-83ed-48ae-a4ab-ef06595559f2, cookie 0x2d2e3b3f34a7b947 00000004:00100000:1.0:1788625405.773914:0:18690:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788625405.774572:0:18690:0:(import.c:65:import_set_state_nolock()) ffff99887b478800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625405.774662:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2390:x1875509185207680:12345-192.168.204.14@tcp:38:mount.lustre.0 Request processed in 949us (3833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625405.774671:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:1.0:1788625405.788662:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625405.788756:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185207808 00000100:00100000:3.0:1788625405.788776:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185207808 00000100:00100000:3.0:1788625405.788858:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:3.0:1788625405.788869:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:0:x1875509185207808:12345-192.168.204.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788625405.788924:0:17241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788625405.789093:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:0:x1875509185207808:12345-192.168.204.14@tcp:41:mount.lustre.0 Request processed in 225us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625405.789102:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00080000:1.0:1788625405.789969:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625405.802404:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625405.802587:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185207936 00000100:00100000:1.0:1788625405.802600:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185207936 00000100:00100000:1.0:1788625405.802712:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:1.0:1788625405.802723:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:15053:x1875509185207936:12345-192.168.204.14@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788625405.802778:0:18690:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788625405.802895:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:15053:x1875509185207936:12345-192.168.204.14@tcp:41:mount.lustre.0 Request processed in 172us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625405.802902:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00080000:2.0:1788625405.803084:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625405.803398:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625405.803548:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185207552 00000100:00100000:3.0:1788625405.803555:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185207552 00000100:00100000:3.0:1788625405.803601:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:3.0:1788625405.803611:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:0:x1875509185207552:12345-192.168.204.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788625405.803628:0:17241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788625405.803664:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:0:x1875509185207552:12345-192.168.204.14@tcp:41:mount.lustre.0 Request processed in 55us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625405.803670:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:2.0:1788625405.806912:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625405.807255:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185208064 00000100:00100000:1.0:1788625405.807266:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185208064 00000100:00100000:1.0:1788625405.807349:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:1.0:1788625405.807386:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:15053:x1875509185208064:12345-192.168.204.14@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788625405.807689:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:15053:x1875509185208064:12345-192.168.204.14@tcp:40:mount.lustre.0 Request processed in 304us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625405.807697:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:1.0:1788625405.817334:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625405.817637:0:17250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185208448 00000100:00100000:3.0:1788625405.817649:0:17250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185208448 00000100:00100000:3.0:1788625405.817777:0:17250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 4 00000100:00100000:3.0:1788625405.817789:0:17250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:15053:x1875509185208448:12345-192.168.204.14@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788625405.817894:0:17250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:15053:x1875509185208448:12345-192.168.204.14@tcp:900:mount.lustre.0 Request processed in 107us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625405.817902:0:17250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 4 00000100:00100000:0.0:1788625405.827283:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625405.827334:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625405.832780:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185208192 00000100:00100000:2.0:1788625405.832803:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185208192 00000100:00100000:2.0:1788625405.832866:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185208320 00000100:00100000:2.0:1788625405.832870:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185208320 00000100:00100000:2.0:1788625405.832896:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:2.0:1788625405.832907:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875509185208192:12345-192.168.204.14@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788625405.832952:0:18747:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3eda7774-83ed-48ae-a4ab-ef06595559f2@192.168.204.14@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:2.0:1788625405.832993:0:18747:0:(genops.c:1385:class_connect()) connect: client 3eda7774-83ed-48ae-a4ab-ef06595559f2, cookie 0x2d2e3b3f34a7b94e 00000100:00100000:0.0:1788625405.833120:0:18745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:0.0:1788625405.833127:0:18745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1875509185208320:12345-192.168.204.14@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788625405.833146:0:18745:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3eda7774-83ed-48ae-a4ab-ef06595559f2@192.168.204.14@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:0.0:1788625405.833166:0:18745:0:(genops.c:1385:class_connect()) connect: client 3eda7774-83ed-48ae-a4ab-ef06595559f2, cookie 0x2d2e3b3f34a7b955 00002000:00100000:2.0:1788625405.833326:0:18747:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3eda7774-83ed-48ae-a4ab-ef06595559f2/ffff998845922800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788625405.833341:0:18747:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:0.0:1788625405.833478:0:18745:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3eda7774-83ed-48ae-a4ab-ef06595559f2/ffff998872646800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788625405.833487:0:18745:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788625405.833716:0:18745:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788625405.833760:0:18745:0:(import.c:65:import_set_state_nolock()) ffff998872640000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625405.833839:0:18745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2390:x1875509185208320:12345-192.168.204.14@tcp:8:mount.lustre.0 Request processed in 709us (6503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625405.833848:0:18745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 19 00002000:00080000:2.0:1788625405.833966:0:18747:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788625405.833981:0:18747:0:(import.c:65:import_set_state_nolock()) ffff998845921800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625405.834127:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2390:x1875509185208192:12345-192.168.204.14@tcp:8:mount.lustre.0 Request processed in 1221us (6854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625405.834135:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:0.0:1788625405.835930:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625405.836113:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185208576 00000100:00100000:3.0:1788625405.836124:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185208576 00000100:00100000:3.0:1788625405.836178:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 1 00000100:00100000:3.0:1788625405.836189:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:15053:x1875509185208576:12345-192.168.204.14@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788625405.836296:0:17243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788625405.836675:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:15053:x1875509185208576:12345-192.168.204.14@tcp:33:mount.lustre.0 Request processed in 486us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625405.836695:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 1 00000100:00100000:1.0:1788625406.111731:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625406.111853:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185208704 00000100:00100000:3.0:1788625406.111866:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185208704 00000100:00100000:3.0:1788625406.112000:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 22 00000100:00100000:3.0:1788625406.112012:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:15091:x1875509185208704:12345-192.168.204.14@tcp:101:mkdir.0 00010000:00010000:3.0:1788625406.112040:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625406.112067:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682c00/0x2d2e3b3f34a7b95c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e537 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625406.112149:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7b963 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625406.112166:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7b963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625406.112182:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7b963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625406.112248:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788625406.112252:0:17241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788625406.112279:0:17241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7b963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625406.112320:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682c00/0x2d2e3b3f34a7b95c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e537 expref: 8 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625406.112345:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7b963 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e537 expref: 7 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625406.112376:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99874244ad00) 00010000:00010000:3.0:1788625406.112380:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625406.112384:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683a00, rc 0) 00000100:00100000:3.0:1788625406.112583:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+7:15091:x1875509185208704:12345-192.168.204.14@tcp:101:mkdir.0 Request processed in 574us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625406.112592:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 22 00010000:00010000:0.0:1788625406.351537:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625407.374561:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625407.504142:0:17997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788625407.762762:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206256640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625407.762850:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625407.762914:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625407.762920:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206256768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625407.762957:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625407.762983:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625407.762992:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998858355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206256896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625407.763018:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625407.763041:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206256640 00000100:00100000:2.0:1788625407.763048:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206256640 00000100:00100000:2.0:1788625407.763100:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206256768 00000100:00100000:2.0:1788625407.763103:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206256768 00000100:00100000:2.0:1788625407.763116:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206256896 00000100:00100000:2.0:1788625407.763118:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206256896 00000100:00100000:2.0:1788625407.763133:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788625407.763141:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206256640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788625407.763170:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788625407.763210:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206256640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625407.763217:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788625407.763231:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625407.763236:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206256768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625407.763244:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788625407.763261:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206256768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 25us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625407.763266:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625407.763284:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788625407.763290:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206256896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625407.763322:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788625407.763352:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206256896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625407.763374:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788625407.763391:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788625407.763395:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788625407.763426:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206256768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625407.763439:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206256640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625407.763472:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998858355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206256896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625407.767787:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3636:1875509206257024:0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.767874:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625407.767925:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206257536:0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.767956:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625407.767979:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206258048:0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.768013:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625407.768042:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788625407.768049:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206257408:0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.768099:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625407.768121:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206257920:0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.768142:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625407.768173:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206257152:0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.768198:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625407.768214:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206257664:0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.768233:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625407.768250:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206258176:0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.768269:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625407.768308:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788625407.768314:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206257280:0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.768335:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625407.768344:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206257792:0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.768362:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625407.768389:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206257024 00000100:00100000:2.0:1788625407.768397:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206257024 00000100:00100000:2.0:1788625407.768443:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788625407.768453:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3636:x1875509206257024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.768504:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3636:x1875509206257024:12345-0@lo:400:kworker.0 Request processed in 52us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625407.768511:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788625407.768574:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206258048 00000100:00100000:2.0:1788625407.768577:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206258048 00000100:00100000:2.0:1788625407.768607:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206257920 00000100:00100000:2.0:1788625407.768610:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206257920 00000100:00100000:2.0:1788625407.768621:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206257664 00000100:00100000:2.0:1788625407.768623:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206257664 00000100:00100000:2.0:1788625407.768632:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206258176 00000100:00100000:2.0:1788625407.768634:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206258176 00000100:00100000:2.0:1788625407.768643:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206257280 00000100:00100000:2.0:1788625407.768645:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206257280 00000100:00100000:2.0:1788625407.768654:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206257792 00000100:00100000:2.0:1788625407.768657:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206257792 00000100:00100000:2.0:1788625407.768669:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788625407.768676:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206258048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.768709:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206258048:12345-0@lo:400:kworker.0 Request processed in 34us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625407.768716:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788625407.768735:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788625407.768741:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206257920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.768771:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206257920:12345-0@lo:400:kworker.0 Request processed in 30us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625407.768777:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788625407.768787:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788625407.768793:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206257664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.768822:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206257664:12345-0@lo:400:kworker.0 Request processed in 29us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625407.768828:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788625407.768839:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788625407.768845:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206258176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.768868:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206258176:12345-0@lo:400:kworker.0 Request processed in 24us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625407.768874:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788625407.768884:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788625407.768890:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206257280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.768913:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206257280:12345-0@lo:400:kworker.0 Request processed in 24us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625407.768919:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788625407.768929:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788625407.768934:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206257792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.768958:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206257792:12345-0@lo:400:kworker.0 Request processed in 24us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625407.768964:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788625407.768990:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206257408 00000100:00100000:2.0:1788625407.768993:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206257408 00000100:00100000:2.0:1788625407.769016:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206257152 00000100:00100000:2.0:1788625407.769019:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206257152 00000100:00100000:2.0:1788625407.769032:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788625407.769038:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206257408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.769070:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206257408:12345-0@lo:400:kworker.0 Request processed in 33us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625407.769077:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788625407.769087:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788625407.769093:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206257152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.769117:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206257152:12345-0@lo:400:kworker.0 Request processed in 25us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625407.769123:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788625407.769150:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788625407.769154:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625407.769188:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206257280:0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.769199:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206257792:0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.769208:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206257152:0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.769217:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206257664:0@lo:400:kworker.0 00010000:00080000:2.0:1788625407.769229:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99874422bb80 x1875509206258176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625407.769239:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206258176:0@lo:400:kworker.0 00000100:00100000:2.0:1788625407.769272:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206257408:0@lo:400:kworker.0 00010000:00080000:2.0:1788625407.769305:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99874422a300 x1875509206257920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625407.769315:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206257920:0@lo:400:kworker.0 00000100:00100000:3.0:1788625407.769632:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206257536 00000100:00100000:3.0:1788625407.769637:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206257536 00000100:00100000:3.0:1788625407.769678:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625407.769684:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206257536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625407.769725:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206257536:12345-0@lo:400:kworker.0 Request processed in 42us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625407.769731:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788625407.769816:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625407.771432:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3636:1875509206257024:0@lo:400:kworker.0 00000100:00100000:3.0:1788625407.771567:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206257536:0@lo:400:kworker.0 00000100:00100000:3.0:1788625407.771585:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206258048:0@lo:400:kworker.0 00010000:00010000:0.0:1788625408.396085:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788625408.792484:0:19558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3eda7774-83ed-48ae-a4ab-ef06595559f2 00000001:00100000:2.0:1788625408.792499:0:19558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2577c14b-df6c-4b8f-a20a-0ae385000d2e 00000001:00100000:0.0:1788625408.795572:0:17219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3eda7774-83ed-48ae-a4ab-ef06595559f2 00000001:00100000:0.0:1788625408.795591:0:17219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2577c14b-df6c-4b8f-a20a-0ae385000d2e 00000001:00100000:1.0:1788625408.796261:0:17970:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3eda7774-83ed-48ae-a4ab-ef06595559f2 00000001:00100000:1.0:1788625408.796270:0:17970:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2577c14b-df6c-4b8f-a20a-0ae385000d2e 00010000:00010000:0.0:1788625409.420615:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788625409.700448:0:20116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788625410.315955:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206258304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625410.316079:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625410.316141:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206258304 00000100:00100000:1.0:1788625410.316153:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206258304 00000100:00100000:1.0:1788625410.316250:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788625410.316265:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206258304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625410.316326:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788625410.316404:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206258304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625410.316412:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788625410.316588:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206258304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625410.317780:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206258432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625410.317857:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625410.327344:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206258432 00000100:00100000:0.0:1788625410.327369:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206258432 00000100:00100000:0.0:1788625410.327487:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625410.327505:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206258432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625410.327576:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788625410.327714:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206258432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 216us (9856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625410.327743:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788625410.327992:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625410.329642:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206258432:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788625410.445729:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625410.828423:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625410.828463:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206258560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625410.828585:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625410.828682:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206258560 00000100:00100000:2.0:1788625410.828693:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206258560 00000100:00100000:2.0:1788625410.828764:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788625410.828775:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206258560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788625410.828825:0:17978:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788625410.828884:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206258560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625410.828892:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788625410.832597:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206258560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788625411.076830:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625411.076916:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625411.076991:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625411.077017:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185209088 00000100:00100000:3.0:1788625411.077021:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625411.077046:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625411.077051:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185209088 00000100:00100000:3.0:1788625411.077080:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625411.077113:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625411.077139:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625411.077157:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185209600 00000100:00100000:2.0:1788625411.077161:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185209600 00000100:00100000:3.0:1788625411.077170:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625411.077184:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185208960 00000100:00100000:2.0:1788625411.077197:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185208960 00000100:00100000:3.0:1788625411.077204:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185209344 00000100:00100000:3.0:1788625411.077222:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185209344 00000100:00100000:2.0:1788625411.077230:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185209472 00000100:00100000:2.0:1788625411.077235:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185209472 00000100:00100000:2.0:1788625411.077266:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 44 00000100:00100000:3.0:1788625411.077271:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185209856 00000100:00100000:3.0:1788625411.077276:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185209856 00000100:00100000:2.0:1788625411.077281:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2392:x1875509185209088:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625411.077297:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185209216 00000100:00100000:3.0:1788625411.077301:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185209216 00000100:00100000:3.0:1788625411.077318:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185209728 00000100:00100000:3.0:1788625411.077321:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185209728 00000100:00100000:3.0:1788625411.077339:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:3.0:1788625411.077349:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2392:x1875509185209344:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625411.077453:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185208832 00000100:00100000:0.0:1788625411.077458:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185208832 00000100:00100000:0.0:1788625411.077499:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 145 00000100:00100000:0.0:1788625411.077507:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:2392:x1875509185208832:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625411.077657:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2392:x1875509185209088:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 377us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625411.077666:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 44 00000100:00100000:2.0:1788625411.077689:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 45 00000100:00100000:2.0:1788625411.077696:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2392:x1875509185209600:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625411.077993:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2392:x1875509185209344:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 644us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625411.078002:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:3.0:1788625411.078021:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00100000:3.0:1788625411.078028:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2392:x1875509185209856:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625411.078058:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2392:x1875509185209856:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 31us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625411.078065:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00100000:3.0:1788625411.078078:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:3.0:1788625411.078084:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2392:x1875509185209216:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625411.078121:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2392:x1875509185209216:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 37us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625411.078128:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:3.0:1788625411.078141:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:3.0:1788625411.078148:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2392:x1875509185209728:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625411.078174:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2392:x1875509185209728:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 26us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625411.078180:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:3.0:1788625411.078224:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 46 00000100:00100000:3.0:1788625411.078234:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2392:x1875509185208960:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625411.078268:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2392:x1875509185208960:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 36us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625411.079156:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 46 00000100:00100000:3.0:1788625411.079189:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 47 00000100:00100000:3.0:1788625411.079201:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2392:x1875509185209472:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625411.079303:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2392:x1875509185209472:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 105us (2162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625411.079311:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 47 00000100:00080000:3.0:1788625411.079361:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625411.079369:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625411.079374:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625411.079377:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625411.081049:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:2392:x1875509185208832:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 3509us (4204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625411.081069:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 145 00000100:00100000:2.0:1788625411.084450:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2392:x1875509185209600:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 6728us (7402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625411.084475:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 45 00010000:00010000:2.0:1788625411.469759:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788625411.861981:0:18741:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3eda7774-83ed-48ae-a4ab-ef06595559f2 00010000:00010000:3.0:1788625412.495684:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625412.875761:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788625412.875945:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206258688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625412.876114:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625412.876195:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206258816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625412.876226:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625412.876257:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3638:1875509206258944:0@lo:400:kworker.0 00000100:00100000:2.0:1788625412.876290:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625412.876709:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206259456:0@lo:400:kworker.0 00000100:00100000:2.0:1788625412.876750:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625412.876773:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206259968:0@lo:400:kworker.0 00000100:00100000:2.0:1788625412.876810:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625412.876828:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206260480:0@lo:400:kworker.0 00000100:00100000:2.0:1788625412.876849:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625412.876871:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788625412.876877:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206259328:0@lo:400:kworker.0 00000100:00100000:2.0:1788625412.876900:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625412.876920:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206259840:0@lo:400:kworker.0 00000100:00100000:2.0:1788625412.876942:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625412.877146:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206259456 00000100:00100000:3.0:1788625412.877156:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206259456 00000100:00100000:3.0:1788625412.877221:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206259968 00000100:00100000:3.0:1788625412.877224:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206259968 00000100:00100000:3.0:1788625412.877238:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206260480 00000100:00100000:3.0:1788625412.877240:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206260480 00000100:00100000:3.0:1788625412.877269:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788625412.877278:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206259456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625412.877349:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206259456:12345-0@lo:400:kworker.0 Request processed in 73us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625412.877356:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788625412.877373:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788625412.877379:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206259968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625412.877409:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206259968:12345-0@lo:400:kworker.0 Request processed in 30us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625412.877414:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788625412.877425:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788625412.877432:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206260480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625412.877460:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206260480:12345-0@lo:400:kworker.0 Request processed in 29us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625412.877466:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788625412.877495:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206259328 00000100:00100000:3.0:1788625412.877499:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206259328 00000100:00100000:2.0:1788625412.877726:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206260352:0@lo:400:kworker.0 00000100:00100000:2.0:1788625412.877760:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625412.877805:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206259456:0@lo:400:kworker.0 00000100:00100000:2.0:1788625412.877817:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206259968:0@lo:400:kworker.0 00010000:00080000:2.0:1788625412.877831:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987441faa00 x1875509206260480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625412.877843:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206260480:0@lo:400:kworker.0 00000100:00100000:2.0:1788625412.877888:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206258688 00000100:00100000:2.0:1788625412.877893:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206258688 00000100:00100000:2.0:1788625412.877921:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206258816 00000100:00100000:2.0:1788625412.877925:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206258816 00000100:00100000:2.0:1788625412.877938:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788625412.877945:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206258688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625412.878001:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788625412.878043:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206258688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625412.878058:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788625412.878072:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788625412.878078:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875509206258816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788625412.878095:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788625412.878124:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875509206258816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625412.878130:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788625412.878457:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206258944 00000100:00100000:0.0:1788625412.878462:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206258944 00000100:00100000:0.0:1788625412.878497:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788625412.878504:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3638:x1875509206258944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.878558:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3638:x1875509206258944:12345-0@lo:400:kworker.0 Request processed in 54us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625412.878564:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788625412.878696:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206259072:0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.878728:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625412.878751:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206259584:0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.878771:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625412.878788:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206260096:0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.878808:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625412.878823:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206260608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625412.878842:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625412.878863:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788625412.878879:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206259200:0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.878904:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625412.878944:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206258688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625412.878966:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206258816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625412.878991:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3638:1875509206258944:0@lo:400:kworker.0 00000100:00100000:1.0:1788625412.880461:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206259072 00000100:00100000:1.0:1788625412.880473:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206259072 00000100:00100000:1.0:1788625412.880927:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206259584 00000100:00100000:1.0:1788625412.880932:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206259584 00000100:00100000:1.0:1788625412.880952:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788625412.880960:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206259072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625412.881043:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206259072:12345-0@lo:400:kworker.0 Request processed in 83us (2314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625412.881064:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788625412.881079:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788625412.881087:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206259584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625412.881119:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206259584:12345-0@lo:400:kworker.0 Request processed in 33us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625412.881125:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788625412.881750:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206259712:0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.881788:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625412.884383:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206259840 00000100:00100000:3.0:1788625412.884399:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206259840 00000100:00100000:3.0:1788625412.884467:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206259200 00000100:00100000:3.0:1788625412.884471:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206259200 00000100:00100000:3.0:1788625412.884492:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788625412.884502:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206259328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.887868:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206260224:0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.887940:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625412.888003:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206259072:0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.888018:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206259584:0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.888071:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206260608 00000100:00100000:0.0:1788625412.888077:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206260608 00000100:00100000:0.0:1788625412.888135:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788625412.888143:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1875509206260608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788625412.888274:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788625412.888388:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1875509206260608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 244us (9543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625412.888396:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788625412.888439:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206260608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625412.889026:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206260352 00000100:00100000:0.0:1788625412.889032:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206260352 00000100:00100000:0.0:1788625412.889056:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206260096 00000100:00100000:0.0:1788625412.889059:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206260096 00000100:00100000:0.0:1788625412.889070:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206260224 00000100:00100000:0.0:1788625412.889072:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206260224 00000100:00100000:0.0:1788625412.889086:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788625412.889107:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206260352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.889184:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206260352:12345-0@lo:400:kworker.0 Request processed in 68us (11414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625412.889197:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788625412.889213:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788625412.889218:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206260096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.889253:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206260096:12345-0@lo:400:kworker.0 Request processed in 35us (10444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625412.889259:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788625412.889269:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788625412.889275:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206260224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.889313:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206260224:12345-0@lo:400:kworker.0 Request processed in 27us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625412.889319:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788625412.889337:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788625412.889341:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788625412.889344:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625412.889346:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625412.889360:0:19761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206259712 00000100:00100000:0.0:1788625412.889364:0:19761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206259712 00000100:00100000:0.0:1788625412.889388:0:19761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625412.889394:0:19761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206259840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.889424:0:19761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206259840:12345-0@lo:400:kworker.0 Request processed in 30us (12481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625412.889429:0:19761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625412.889441:0:19761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788625412.889446:0:19761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206259200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.889471:0:19761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206259200:12345-0@lo:400:kworker.0 Request processed in 25us (10566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625412.889484:0:19761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788625412.889495:0:19761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788625412.889499:0:19761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206259712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.889544:0:19761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206259712:12345-0@lo:400:kworker.0 Request processed in 45us (7756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625412.889550:0:19761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788625412.889562:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625412.889582:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206259200:0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.889592:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206259712:0@lo:400:kworker.0 00010000:00080000:0.0:1788625412.889603:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9987441f9500 x1875509206260224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625412.889613:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206260224:0@lo:400:kworker.0 00000100:00100000:0.0:1788625412.889621:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206260096:0@lo:400:kworker.0 00000100:00100000:2.0:1788625412.889829:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206259840:0@lo:400:kworker.0 00000100:00100000:2.0:1788625412.889841:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206260352:0@lo:400:kworker.0 00000100:00100000:3.0:1788625412.895509:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206259328:12345-0@lo:400:kworker.0 Request processed in 10995us (18594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625412.895542:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788625412.895593:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206259328:0@lo:400:kworker.0 00000020:00000080:2.0:1788625413.301766:0:20263:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7c304b20 20000000:00000080:2.0:1788625413.301784:0:20263:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff998872d06400 uarg=0000000000000000 20000000:01000000:2.0:1788625413.301832:0:20263:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788625413.301838:0:20263:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788625413.301843:0:20263:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788625413.302628:0:20264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788625413.302814:0:20263:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788625413.312846:0:20263:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788625413.313201:0:20263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7b96a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.313223:0:20263:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b5ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b5f8 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.313231:0:20263:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998744188600/0x2d2e3b3f34a7b60d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b606 expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.313237:0:20263:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b64c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b645 expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.313245:0:20263:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9988412e5400/0x2d2e3b3f34a7b6e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b6df expref: 23 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.313267:0:20263:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998882171a00/0x2d2e3b3f34a7b8fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e496 expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.313274:0:20263:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998744189a00/0x2d2e3b3f34a7b939 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e506 expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.313282:0:20263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7b96a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.313331:0:20263:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998744189a00/0x2d2e3b3f34a7b939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e506 expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.313346:0:20263:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998744189a00/0x2d2e3b3f34a7b939 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e506 expref: 12 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625413.313362:0:20263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a86680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20263:1875509206260736:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625413.313469:0:20263:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998882171a00/0x2d2e3b3f34a7b8fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e496 expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.313479:0:20263:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998882171a00/0x2d2e3b3f34a7b8fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e496 expref: 12 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625413.313488:0:20263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20263:1875509206260864:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625413.313536:0:20263:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9988412e5400/0x2d2e3b3f34a7b6e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7b6df expref: 23 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.313547:0:20263:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9988412e5400/0x2d2e3b3f34a7b6e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b6df expref: 23 pid: 17232 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625413.313570:0:20263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20263:1875509206260992:0@lo:104: 00000100:00100000:0.0:1788625413.313612:0:20263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625413.313681:0:20263:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b64c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7b645 expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.313690:0:20263:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b64c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b645 expref: 23 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625413.313699:0:20263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20263:1875509206261120:0@lo:104: 00000100:00100000:0.0:1788625413.313732:0:20263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625413.313770:0:20263:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998744188600/0x2d2e3b3f34a7b60d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7b606 expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.313779:0:20263:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998744188600/0x2d2e3b3f34a7b60d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b606 expref: 23 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625413.313787:0:20263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20263:1875509206261248:0@lo:104: 00000100:00100000:0.0:1788625413.313821:0:20263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625413.313839:0:20263:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b5ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5f8 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.313849:0:20263:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b5ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5f8 expref: 23 pid: 17234 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625413.313857:0:20263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20263:1875509206261376:0@lo:104: 00000100:00100000:0.0:1788625413.313876:0:20263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625413.313888:0:20263:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788625413.313895:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206260992 00000100:00100000:1.0:1788625413.313905:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206260992 00000100:00100000:1.0:1788625413.313949:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206261120 00000100:00100000:1.0:1788625413.313952:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206261120 00000100:00100000:1.0:1788625413.313962:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206261248 00000100:00100000:1.0:1788625413.313965:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206261248 00000100:00100000:1.0:1788625413.313971:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206261376 00000100:00100000:1.0:1788625413.313974:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206261376 00000100:00100000:1.0:1788625413.313985:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625413.313994:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+6:20263:x1875509206260992:12345-0@lo:104: 00010000:00010000:1.0:1788625413.314009:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b6df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b6e6 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314081:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788625413.314088:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+6:20263:x1875509206260992:12345-0@lo:104: Request processed in 95us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625413.314095:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625413.314111:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625413.314117:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+5:20263:x1875509206261120:12345-0@lo:104: 00010000:00010000:1.0:1788625413.314124:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7b645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b64c expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314180:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788625413.314185:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+5:20263:x1875509206261120:12345-0@lo:104: Request processed in 69us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625413.314192:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625413.314204:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788625413.314210:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+4:20263:x1875509206261248:12345-0@lo:104: 00010000:00010000:1.0:1788625413.314218:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff9988412e5e00/0x2d2e3b3f34a7b606 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b60d expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314361:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788625413.314366:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+4:20263:x1875509206261248:12345-0@lo:104: Request processed in 157us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625413.314373:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788625413.314385:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788625413.314391:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+3:20263:x1875509206261376:12345-0@lo:104: 00010000:00010000:1.0:1788625413.314399:0:17222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff9988412e4600/0x2d2e3b3f34a7b5f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b5ff expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314424:0:17222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788625413.314429:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+3:20263:x1875509206261376:12345-0@lo:104: Request processed in 39us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625413.314435:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788625413.314452:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788625413.314458:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b6df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b6e6 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314475:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625413.314479:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b6df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7b6e6 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314487:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b6df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7b6e6 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625413.314494:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b6df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7b6e6 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625413.314499:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788625413.314548:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b6df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b6e6 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314555:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625413.314575:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b6df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b6e6 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314583:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b6df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b6e6 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314596:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788625413.314599:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7b645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b64c expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314605:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4000 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625413.314608:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7b645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7b64c expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314624:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7b645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7b64c expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625413.314630:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7b645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7b64c expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625413.314635:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788625413.314651:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7b645 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b64c expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314657:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625413.314673:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7b645 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b64c expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314679:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7b645 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b64c expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314689:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625413.314693:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff9988412e5e00/0x2d2e3b3f34a7b606 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b60d expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314699:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625413.314702:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff9988412e5e00/0x2d2e3b3f34a7b606 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7b60d expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314708:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff9988412e5e00/0x2d2e3b3f34a7b606 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7b60d expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625413.314714:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff9988412e5e00/0x2d2e3b3f34a7b606 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7b60d expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625413.314725:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788625413.314740:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff9988412e5e00/0x2d2e3b3f34a7b606 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b60d expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314745:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625413.314752:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff9988412e5e00/0x2d2e3b3f34a7b606 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b60d expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314758:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff9988412e5e00/0x2d2e3b3f34a7b606 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b60d expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314765:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625413.314768:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff9988412e4600/0x2d2e3b3f34a7b5f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7b5ff expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314772:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4600 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625413.314775:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff9988412e4600/0x2d2e3b3f34a7b5f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7b5ff expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314781:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff9988412e4600/0x2d2e3b3f34a7b5f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7b5ff expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625413.314786:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff9988412e4600/0x2d2e3b3f34a7b5f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7b5ff expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625413.314791:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788625413.314799:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff9988412e4600/0x2d2e3b3f34a7b5f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b5ff expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314804:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625413.314815:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff9988412e4600/0x2d2e3b3f34a7b5f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b5ff expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314821:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff9988412e4600/0x2d2e3b3f34a7b5f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7b5ff expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.314834:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625413.314835:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625413.314837:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625413.314843:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625413.314862:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3636:1875509206261504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625413.314893:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625413.314918:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625413.314922:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3636:1875509206261888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625413.314940:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625413.314966:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206261632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625413.314988:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625413.315006:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625413.315010:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206261760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625413.315026:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625413.315054:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206261504 00000100:00100000:1.0:1788625413.315059:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206261504 00010000:00010000:1.0:1788625413.315082:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9988412e5400/0x2d2e3b3f34a7b6e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b6df expref: 24 pid: 17232 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625413.315098:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206261888 00000100:00100000:1.0:1788625413.315101:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206261888 00010000:00010000:1.0:1788625413.315111:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b5ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5f8 expref: 25 pid: 17234 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625413.315134:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206261632 00000100:00100000:1.0:1788625413.315137:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206261632 00010000:00010000:1.0:1788625413.315149:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b64c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b645 expref: 26 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625413.315158:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206261760 00000100:00100000:1.0:1788625413.315160:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206261760 00010000:00010000:1.0:1788625413.315182:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998744188600/0x2d2e3b3f34a7b60d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b606 expref: 27 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625413.315195:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625413.315202:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+27:3636:x1875509206261504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625413.315227:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788625413.315327:0:20263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20263:1875509206260992:0@lo:104: 00000100:00100000:0.0:1788625413.315349:0:20263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20263:1875509206261120:0@lo:104: 00000100:00100000:0.0:1788625413.315357:0:20263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20263:1875509206261248:0@lo:104: 00000100:00100000:0.0:1788625413.315363:0:20263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20263:1875509206261376:0@lo:104: 00000100:00100000:0.0:1788625413.315397:0:17225:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788625413.315407:0:17225:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788625413.315567:0:17224:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788625413.315577:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788625413.315584:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+27:3636:x1875509206261888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625413.315593:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625413.315600:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b5ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5f8 expref: 27 pid: 17234 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.315613:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b5ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5f8 expref: 27 pid: 17234 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.315628:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743ae1800/0x2d2e3b3f34a7b5ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b5f8 expref: 27 pid: 17234 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.315642:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625413.315677:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+26:3636:x1875509206261888:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625413.315683:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788625413.315703:0:17224:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788625413.315710:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625413.315717:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+25:3637:x1875509206261632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625413.315727:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625413.315732:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b64c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b645 expref: 25 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.315752:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b64c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b645 expref: 25 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.315761:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743ae0200/0x2d2e3b3f34a7b64c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b645 expref: 25 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.315770:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625413.315812:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3637:x1875509206261632:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625413.315818:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625413.315830:0:17224:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788625413.315835:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625413.315841:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:3637:x1875509206261760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625413.315849:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625413.315853:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998744188600/0x2d2e3b3f34a7b60d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b606 expref: 23 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.315862:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998744188600/0x2d2e3b3f34a7b60d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b606 expref: 23 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.315871:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998744188600/0x2d2e3b3f34a7b60d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b606 expref: 23 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.315880:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625413.315900:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:3637:x1875509206261760:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625413.315906:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625413.316195:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3636:1875509206261888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625413.316245:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206261760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625413.316253:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206261632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625413.316666:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9988412e5400/0x2d2e3b3f34a7b6e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b6df expref: 21 pid: 17232 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.316678:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9988412e5400/0x2d2e3b3f34a7b6e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b6df expref: 21 pid: 17232 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.316690:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e5400/0x2d2e3b3f34a7b6e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7b6df expref: 21 pid: 17232 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625413.316702:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625413.316761:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:3636:x1875509206261504:12345-0@lo:103:ldlm_bl.0 Request processed in 1559us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625413.316769:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788625413.316912:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3636:1875509206261504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625413.321720:0:20263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a86680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20263:1875509206260736:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625413.321838:0:20263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20263:1875509206260864:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625413.321885:0:20263:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7b96a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625413.322351:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625413.322402:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625413.322622:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185209984 00000100:00100000:0.0:1788625413.322631:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185209984 00010000:00010000:0.0:1788625413.322673:0:17224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998744189a00/0x2d2e3b3f34a7b939 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e506 expref: 13 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625413.322705:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185210112 00000100:00100000:0.0:1788625413.322709:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185210112 00010000:00010000:0.0:1788625413.322721:0:17224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998882171a00/0x2d2e3b3f34a7b8fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e496 expref: 14 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625413.322739:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 13 00000100:00100000:0.0:1788625413.322747:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+14:2393:x1875509185209984:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625413.322781:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625413.322789:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998744189a00/0x2d2e3b3f34a7b939 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e506 expref: 14 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625413.322944:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00100000:3.0:1788625413.322957:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+14:2394:x1875509185210112:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625413.322966:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625413.322972:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998882171a00/0x2d2e3b3f34a7b8fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e496 expref: 14 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625413.322985:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998882171a00/0x2d2e3b3f34a7b8fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e496 expref: 14 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625413.323004:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882171a00/0x2d2e3b3f34a7b8fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e496 expref: 14 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625413.323020:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625413.323088:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:2394:x1875509185210112:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 135us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625413.323095:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 14 00010000:00010000:0.0:1788625413.323152:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998744189a00/0x2d2e3b3f34a7b939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e506 expref: 12 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.323174:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998744189a00/0x2d2e3b3f34a7b939 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e506 expref: 12 pid: 17233 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.323186:0:17224:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7b96a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.323195:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7b96a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.323217:0:17224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7b96a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.323224:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7b96a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.324009:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7b96a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.324018:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7b96a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.324026:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625413.324031:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7b96a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.324041:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7b96a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.324064:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7b96a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625413.324078:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625413.324103:0:20263:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7b96a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625413.324116:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:2393:x1875509185209984:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 1366us (1764us total) trans 0 rc 0/0 00010000:00010000:2.0:1788625413.324117:0:20263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7b96a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625413.324131:0:20263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882170c00/0x2d2e3b3f34a7b96a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625413.324133:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 13 00010000:00010000:1.0:1788625413.515677:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625414.539767:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625414.910647:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625414.910735:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185210240 00000100:00100000:2.0:1788625414.910746:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185210240 00000100:00100000:2.0:1788625414.910807:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 147 00000100:00100000:2.0:1788625414.910817:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:14938:x1875509185210240:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625414.910833:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625414.910855:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998744188a00/0x2d2e3b3f34a7b971 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e53e expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.910885:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998744188a00/0x2d2e3b3f34a7b971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e53e expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.910897:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998744188a00/0x2d2e3b3f34a7b971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e53e expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.910907:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998744188a00, rc 0) 00000100:00100000:2.0:1788625414.910968:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+12:14938:x1875509185210240:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 Request processed in 152us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625414.910975:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 147 00000100:00100000:1.0:1788625414.914722:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625414.914915:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185210368 00000100:00100000:0.0:1788625414.914925:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185210368 00000100:00100000:0.0:1788625414.914986:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 148 00000100:00100000:0.0:1788625414.915005:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+12:14938:x1875509185210368:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625414.915167:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+12:14938:x1875509185210368:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 Request processed in 164us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625414.915176:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 148 00000100:00100000:0.0:1788625414.924550:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625414.924650:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185210496 00000100:00100000:1.0:1788625414.924662:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185210496 00000100:00100000:1.0:1788625414.924723:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 149 00000100:00100000:1.0:1788625414.924734:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+12:14938:x1875509185210496:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625414.924898:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+12:14938:x1875509185210496:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 Request processed in 166us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625414.924906:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 149 10000000:01000000:2.0:1788625414.925160:0:17236:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788625414.925173:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9987427a5000 from 13 10000000:01000000:2.0:1788625414.925177:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788625414.925218:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.925229:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.925239:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625414.925263:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.925303:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625414.925343:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866c64780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625414.925562:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206262016 00000100:00100000:0.0:1788625414.925567:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206262016 00000100:00100000:0.0:1788625414.925603:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788625414.925610:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:17236:x1875509206262016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625414.925621:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625414.925635:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7b97f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b978 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625414.925659:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7b97f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b978 expref: 21 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625414.925671:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7b97f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b978 expref: 21 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625414.925680:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882170800, rc 0) 00000100:00100000:0.0:1788625414.925722:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:17236:x1875509206262016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625414.925729:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788625414.926260:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625414.926280:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b97f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.926291:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b97f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625414.926359:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.926402:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625414.926492:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866c64780 going to sleep for 11 seconds 00000100:00100000:1.0:1788625414.928452:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206262144 00000100:00100000:1.0:1788625414.928477:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206262144 00000100:00100000:1.0:1788625414.928557:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788625414.928568:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:17236:x1875509206262144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625414.928745:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:17236:x1875509206262144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625414.928753:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788625414.928865:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.928913:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.928966:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625414.929001:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866c64780 going to sleep for 11 seconds 00000100:00100000:3.0:1788625414.929039:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206262272 00000100:00100000:3.0:1788625414.929044:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206262272 00000100:00100000:3.0:1788625414.929082:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788625414.929090:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:17236:x1875509206262272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625414.929232:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:17236:x1875509206262272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625414.929239:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788625414.929313:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788625414.930396:0:20333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788625414.930825:0:17236:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788625414.930847:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625414.930857:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b97f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.930870:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b97f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625414.930881:0:17236:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788625414.930884:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998743b76800 from 13 10000000:01000000:2.0:1788625414.930887:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:3.0:1788625414.930897:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00010000:00010000:2.0:1788625414.930920:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.930929:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.930941:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625414.930962:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.931007:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625414.931347:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866c64780 going to sleep for 11 seconds 00000100:00100000:1.0:1788625414.934849:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185210624 00000100:00100000:1.0:1788625414.934864:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185210624 00000100:00100000:1.0:1788625414.934964:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206262400 00000100:00100000:1.0:1788625414.934969:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206262400 00000100:00100000:1.0:1788625414.934992:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 153 00000100:00100000:1.0:1788625414.935000:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+12:14938:x1875509185210624:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625414.935017:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625414.935034:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998882044600/0x2d2e3b3f34a7b98d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e545 expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625414.935063:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998882044600/0x2d2e3b3f34a7b98d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e545 expref: 13 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625414.935075:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998882044600/0x2d2e3b3f34a7b98d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e545 expref: 13 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625414.935098:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882044600, rc 0) 00000100:00100000:1.0:1788625414.935184:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:14938:x1875509185210624:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 Request processed in 184us (4290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625414.935191:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 153 00000100:00100000:1.0:1788625414.935221:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788625414.935227:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:17236:x1875509206262400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625414.935233:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625414.935242:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998882044c00/0x2d2e3b3f34a7b994 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b986 expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625414.935255:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998882044c00/0x2d2e3b3f34a7b994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b986 expref: 22 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625414.935263:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998882044c00/0x2d2e3b3f34a7b994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b986 expref: 22 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625414.935270:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882044c00, rc 0) 00000100:00100000:1.0:1788625414.935325:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:17236:x1875509206262400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (4317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625414.935331:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788625414.935601:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625414.935621:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b994 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.935630:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b994 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625414.935725:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.935763:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625414.935797:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866c64780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625414.935810:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206262528 00000100:00100000:2.0:1788625414.935814:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206262528 00000100:00100000:2.0:1788625414.935836:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788625414.935842:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:17236:x1875509206262528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.935950:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:17236:x1875509206262528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625414.935957:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788625414.935987:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.936012:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.936052:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625414.936065:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866c64780 going to sleep for 11 seconds 00000100:00100000:2.0:1788625414.936075:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206262656 00000100:00100000:2.0:1788625414.936078:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206262656 00000100:00100000:2.0:1788625414.936093:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788625414.936099:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:17236:x1875509206262656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.936189:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:17236:x1875509206262656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625414.936196:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788625414.936233:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788625414.936909:0:20334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788625414.936985:0:17236:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788625414.937002:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625414.937011:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b994 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.937022:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b994 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625414.937033:0:17236:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788625414.937035:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9987427c7800 from 13 10000000:01000000:2.0:1788625414.937038:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788625414.937064:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.937072:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.937082:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625414.937099:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.937151:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625414.937171:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866c640c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625414.937188:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206262784 00000100:00100000:2.0:1788625414.937193:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206262784 00000100:00100000:2.0:1788625414.937218:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788625414.937225:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:17236:x1875509206262784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625414.937235:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625414.937247:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998859be9400/0x2d2e3b3f34a7b9a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b99b expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.937278:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998859be9400/0x2d2e3b3f34a7b9a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b99b expref: 23 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.937288:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998859be9400/0x2d2e3b3f34a7b9a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b99b expref: 23 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.937297:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be9400, rc 0) 00000100:00100000:2.0:1788625414.937329:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:17236:x1875509206262784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625414.937336:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788625414.937371:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625414.937384:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b9a2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625414.937391:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b9a2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625414.937434:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.937461:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625414.937473:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866c640c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625414.937484:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206262912 00000100:00100000:2.0:1788625414.937487:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206262912 00000100:00100000:2.0:1788625414.937503:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788625414.937510:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:17236:x1875509206262912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.937617:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:17236:x1875509206262912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625414.937637:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788625414.937668:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206262912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.937693:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206263040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.937727:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625414.937739:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866c640c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625414.937749:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206263040 00000100:00100000:2.0:1788625414.937752:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206263040 00000100:00100000:2.0:1788625414.937769:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788625414.937774:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:17236:x1875509206263040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.937843:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:17236:x1875509206263040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625414.937849:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788625414.937886:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206263040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625414.942645:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625414.942685:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185210752 00000100:00100000:0.0:1788625414.942697:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185210752 00000100:00100000:0.0:1788625414.942756:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 160 00000100:00100000:0.0:1788625414.942767:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:14938:x1875509185210752:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625414.942939:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:14938:x1875509185210752:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 Request processed in 174us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625414.942947:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 160 00000040:00080000:2.0:1788625414.944002:0:20335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788625414.944184:0:17236:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788625414.944218:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788625414.944231:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b9a2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625414.944244:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b9a2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625414.944255:0:17236:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788625414.944259:0:17236:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998848aae000 from 13 10000000:01000000:0.0:1788625414.944261:0:17236:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788625414.944302:0:17236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625414.944311:0:17236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625414.944321:0:17236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625414.944350:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206263168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625414.944791:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625414.944833:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885e645540 going to sleep for 11 seconds 00000100:00100000:3.0:1788625414.945075:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206263168 00000100:00100000:3.0:1788625414.945084:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206263168 00000100:00100000:3.0:1788625414.945147:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788625414.945156:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:17236:x1875509206263168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625414.945169:0:17232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625414.945184:0:17232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7b9b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7b9a9 expref: -99 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625414.945210:0:17232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7b9b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b9a9 expref: 24 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625414.945220:0:17232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7b9b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b9a9 expref: 24 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625414.945229:0:17232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682c00, rc 0) 00000100:00100000:3.0:1788625414.945290:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:17236:x1875509206263168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625414.945297:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788625414.945617:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206263168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625414.945636:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b9b0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625414.945661:0:17236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b9b0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625414.945735:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206263296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625414.945767:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625414.945792:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885e645540 going to sleep for 11 seconds 00000100:00100000:3.0:1788625414.946381:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206263296 00000100:00100000:3.0:1788625414.946387:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206263296 00000100:00100000:3.0:1788625414.946430:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788625414.946438:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:17236:x1875509206263296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.948826:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206263296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625414.948902:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206263424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625414.949088:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:17236:x1875509206263296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2648us (3316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625414.949102:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788625414.951303:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625414.952087:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625414.952155:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885235fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625414.952215:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185210880 00000100:00100000:1.0:1788625414.952226:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185210880 00000100:00100000:1.0:1788625414.952285:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206263424 00000100:00100000:1.0:1788625414.952288:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206263424 00000100:00100000:1.0:1788625414.952308:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 163 00000100:00100000:1.0:1788625414.952320:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cb17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:14938:x1875509185210880:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625414.952721:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cb17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:14938:x1875509185210880:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 Request processed in 401us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625414.952731:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 163 00000100:00100000:1.0:1788625414.952767:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788625414.952774:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:17236:x1875509206263424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625414.952852:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:17236:x1875509206263424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625414.952858:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788625414.952986:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:17236:1875509206263424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788625414.954385:0:20336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788625414.954625:0:17236:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788625414.954655:0:17236:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625414.954668:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b9b0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625414.954680:0:17236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b9b0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788625414.990093:0:17273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788625415.437682:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206263552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625415.437778:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625415.437853:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206263552 00000100:00100000:3.0:1788625415.437862:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206263552 00000100:00100000:3.0:1788625415.437928:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788625415.437939:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206263552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788625415.437979:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788625415.438046:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206263552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625415.438054:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788625415.438104:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206263552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625415.445893:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206263680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625415.445995:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625415.446096:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206263680 00000100:00100000:3.0:1788625415.446105:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206263680 00000100:00100000:3.0:1788625415.446191:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788625415.446202:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206263680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788625415.446367:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1788625415.451635:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625415.455316:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206263680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9104us (9309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625415.455332:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625415.457828:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206263680:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788625415.563869:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625415.947799:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206263808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625415.948015:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625415.954577:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206263808 00000100:00100000:3.0:1788625415.954597:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206263808 00000100:00100000:3.0:1788625415.954755:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788625415.954767:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206263808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788625415.954828:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788625415.955019:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206263808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 254us (7003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625415.955027:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788625415.955135:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206263808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625416.193968:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625416.194022:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625416.194055:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625416.194080:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625416.194103:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625416.194183:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185211136 00000100:00100000:2.0:1788625416.194193:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185211136 00000100:00100000:2.0:1788625416.194254:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185211648 00000100:00100000:2.0:1788625416.194257:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185211648 00000100:00100000:2.0:1788625416.194280:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 54 00000100:00100000:2.0:1788625416.194302:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2392:x1875509185211136:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625416.194350:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625416.194377:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2392:x1875509185211136:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 74us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625416.194385:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625416.194392:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 54 00000100:00100000:2.0:1788625416.194408:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185211264 00000100:00100000:2.0:1788625416.194411:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185211264 00000100:00100000:2.0:1788625416.194429:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 55 00000100:00100000:2.0:1788625416.194434:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2392:x1875509185211648:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625416.194459:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2392:x1875509185211648:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 24us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625416.194465:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 55 00000100:00100000:2.0:1788625416.194475:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00100000:2.0:1788625416.194481:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2392:x1875509185211264:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625416.194501:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2392:x1875509185211264:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 20us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625416.194506:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00100000:2.0:1788625416.194543:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185211392 00000100:00100000:2.0:1788625416.194547:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185211392 00000100:00100000:2.0:1788625416.194580:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185211904 00000100:00100000:2.0:1788625416.194583:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185211904 00000100:00100000:2.0:1788625416.194598:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185211520 00000100:00100000:2.0:1788625416.194600:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185211520 00000100:00100000:2.0:1788625416.194613:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00100000:2.0:1788625416.194618:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2392:x1875509185211392:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625416.194642:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2392:x1875509185211392:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 24us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625416.194647:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00100000:2.0:1788625416.194658:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:2.0:1788625416.194664:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2392:x1875509185211904:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625416.194683:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2392:x1875509185211904:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 20us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625416.194689:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:2.0:1788625416.194699:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:2.0:1788625416.194704:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2392:x1875509185211520:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625416.194722:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2392:x1875509185211520:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 18us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625416.194727:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:1.0:1788625416.195069:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185211008 00000100:00100000:1.0:1788625416.195075:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185211008 00000100:00100000:1.0:1788625416.195125:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 165 00000100:00100000:1.0:1788625416.195133:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:2392:x1875509185211008:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625416.195164:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:2392:x1875509185211008:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 32us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625416.195181:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 165 00000100:00080000:1.0:1788625416.195209:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625416.195214:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788625416.195216:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625416.195218:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625416.200370:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625416.200436:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625416.203077:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185212032 00000100:00100000:3.0:1788625416.203092:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185212032 00000100:00100000:3.0:1788625416.203193:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:3.0:1788625416.203203:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2392:x1875509185212032:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625416.203285:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2392:x1875509185212032:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 84us (2848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625416.203293:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:2.0:1788625416.203338:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185211776 00000100:00100000:2.0:1788625416.203345:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185211776 00000100:00100000:2.0:1788625416.203386:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00100000:2.0:1788625416.203394:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2392:x1875509185211776:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625416.203437:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2392:x1875509185211776:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 45us (3083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625416.203461:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00080000:1.0:1788625416.209597:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625416.209618:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788625416.590152:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625417.086663:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625417.086765:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185212160 00000100:00100000:3.0:1788625417.086777:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185212160 00000100:00100000:3.0:1788625417.086867:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:3.0:1788625417.086881:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:15607:x1875509185212160:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625417.086911:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625417.086947:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683e00/0x2d2e3b3f34a7b9b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e54c expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087034:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087054:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087070:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087124:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7b9c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087132:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7b9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087139:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7b9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087243:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7b9cc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087251:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7b9cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087258:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7b9cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625417.087294:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788625417.087299:0:17240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788625417.087346:0:17240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7b9cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087360:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087367:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087375:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087395:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625417.087400:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087408:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087421:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99874244ad00) 00010000:00010000:3.0:1788625417.087424:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625417.087429:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087435:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087450:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7b9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087456:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7b9c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087462:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7b9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087467:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625417.087469:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7b9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087475:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7b9c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087494:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9987426d8a00) 00010000:00010000:3.0:1788625417.087496:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625417.087499:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7b9c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087505:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7b9c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087596:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683e00/0x2d2e3b3f34a7b9b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e54c expref: 8 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087610:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7b9cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e54c expref: 7 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.087617:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9987426d8700) 00010000:00010000:3.0:1788625417.087619:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625417.087622:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682600, rc 0) 00000100:00100000:3.0:1788625417.087692:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:15607:x1875509185212160:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 814us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625417.087699:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:0.0:1788625417.092497:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625417.092956:0:17250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185212288 00000100:00100000:3.0:1788625417.092972:0:17250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185212288 00000100:00100000:3.0:1788625417.093109:0:17250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 5 00000100:00100000:3.0:1788625417.093123:0:17250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:15607:x1875509185212288:12345-192.168.204.14@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788625417.093233:0:17250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:15607:x1875509185212288:12345-192.168.204.14@tcp:900:lhsmtool_posix.0 Request processed in 113us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625417.093242:0:17250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 5 00000100:00100000:0.0:1788625417.098798:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625417.099451:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185212544 00000100:00100000:3.0:1788625417.099465:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185212544 00000100:00100000:0.0:1788625417.099659:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:0.0:1788625417.099669:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874482b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:15607:x1875509185212544:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625417.099691:0:17239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625417.099713:0:17239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882170e00/0x2d2e3b3f34a7b9d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e553 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.099796:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882170a00/0x2d2e3b3f34a7b9da lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.099830:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882170a00/0x2d2e3b3f34a7b9da lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.099844:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882170a00/0x2d2e3b3f34a7b9da lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.099893:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882171a00/0x2d2e3b3f34a7b9e1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.099901:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882171a00/0x2d2e3b3f34a7b9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.099907:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882171a00/0x2d2e3b3f34a7b9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100069:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20c00/0x2d2e3b3f34a7b9e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100078:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20c00/0x2d2e3b3f34a7b9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100086:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20c00/0x2d2e3b3f34a7b9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625417.100104:0:17239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788625417.100270:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882170a00/0x2d2e3b3f34a7b9da lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100278:0:17239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882170a00/0x2d2e3b3f34a7b9da lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100284:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882170a00/0x2d2e3b3f34a7b9da lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100297:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625417.100301:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882170a00/0x2d2e3b3f34a7b9da lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100308:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882170a00/0x2d2e3b3f34a7b9da lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100321:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9987426d8700) 00010000:00010000:0.0:1788625417.100324:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625417.100328:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882170a00/0x2d2e3b3f34a7b9da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100335:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882170a00/0x2d2e3b3f34a7b9da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100349:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882171a00/0x2d2e3b3f34a7b9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100355:0:17239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882171a00/0x2d2e3b3f34a7b9e1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100361:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882171a00/0x2d2e3b3f34a7b9e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100366:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625417.100368:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882171a00/0x2d2e3b3f34a7b9e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100374:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882171a00/0x2d2e3b3f34a7b9e1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100390:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9988749c3700) 00010000:00010000:0.0:1788625417.100393:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625417.100396:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882171a00/0x2d2e3b3f34a7b9e1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.100402:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882171a00/0x2d2e3b3f34a7b9e1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.101374:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882170e00/0x2d2e3b3f34a7b9d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e553 expref: 10 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.101414:0:17239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20c00/0x2d2e3b3f34a7b9e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e553 expref: 9 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.101425:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9988749c3300) 00010000:00010000:0.0:1788625417.101429:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625417.101433:0:17239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da20c00, rc 0) 00000100:00100000:0.0:1788625417.101745:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874482b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+9:15607:x1875509185212544:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 2074us (2957us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788625417.101760:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:1.0:1788625417.108182:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625417.108455:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185212672 00000100:00100000:0.0:1788625417.108479:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185212672 00000100:00100000:0.0:1788625417.108627:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:0.0:1788625417.108640:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+9:15607:x1875509185212672:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788625417.108815:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+9:15607:x1875509185212672:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 Request processed in 177us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625417.108825:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:1.0:1788625417.118044:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625417.119456:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185212800 00000100:00100000:2.0:1788625417.119479:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185212800 00000100:00100000:2.0:1788625417.122450:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 26 00000100:00100000:2.0:1788625417.122483:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:15607:x1875509185212800:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1788625417.126308:0:18690:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3407us 00000100:00100000:3.0:1788625417.161170:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:15607:x1875509185212800:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 Request processed in 38682us (43120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625417.162851:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 26 00000100:00100000:0.0:1788625417.165364:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625417.165478:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185212928 00000100:00100000:3.0:1788625417.165492:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185212928 00000100:00100000:3.0:1788625417.165600:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 27 00000100:00100000:3.0:1788625417.165614:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+9:15613:x1875509185212928:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625417.165646:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625417.165682:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7b9f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e55a expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.165777:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.166317:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.166335:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.169822:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7ba04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.169861:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7ba04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.169880:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7ba04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170105:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170115:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170122:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170129:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625417.170134:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170142:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170157:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99874244ad00) 00010000:00010000:3.0:1788625417.170160:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625417.170166:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170173:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7b9fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170193:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7ba04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170200:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7ba04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170206:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7ba04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170220:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625417.170224:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7ba04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170231:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7ba04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170240:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9987426d8a00) 00010000:00010000:3.0:1788625417.170243:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625417.170245:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7ba04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170252:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7ba04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170317:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7b9f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e55a expref: 10 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170331:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99874244ad00) 00010000:00010000:3.0:1788625417.170334:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625417.170339:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7b9f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e55a expref: 10 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.170351:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682800, rc 0) 00000100:00100000:3.0:1788625417.170445:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+9:15613:x1875509185212928:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 4833us (5089us total) trans 0 rc 301/301 00000100:00100000:3.0:1788625417.170455:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 27 00000100:00100000:3.0:1788625417.177695:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625417.177874:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185213056 00000100:00100000:0.0:1788625417.178051:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185213056 00000100:00100000:1.0:1788625417.178612:0:17249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:1.0:1788625417.178629:0:17249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+9:15613:x1875509185213056:12345-192.168.204.14@tcp:700:lfs.0 00000100:00100000:1.0:1788625417.178764:0:17249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+9:15613:x1875509185213056:12345-192.168.204.14@tcp:700:lfs.0 Request processed in 139us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625417.178773:0:17249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:0.0:1788625417.184734:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625417.184867:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185213312 00000100:00100000:1.0:1788625417.184881:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185213312 00000100:00100000:1.0:1788625417.185058:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 28 00000100:00100000:1.0:1788625417.185071:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+9:15613:x1875509185213312:12345-192.168.204.14@tcp:36:lfs.0 00010000:00010000:1.0:1788625417.185372:0:17239:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625417.185422:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7b924 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e4c7 expref: 9 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625417.185452:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99874244ad00) 00010000:00010000:1.0:1788625417.185471:0:17239:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625417.185836:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba0b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.185858:0:17239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7b963 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e537 expref: 5 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.185869:0:17239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba0b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.185919:0:17239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7b963 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e537 expref: 5 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.185939:0:17239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7b963 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e537 expref: 5 pid: 17241 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625417.185959:0:17239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17239:1875509206263936:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625417.186107:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625417.189760:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625417.190362:0:17239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17239:1875509206263936:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625417.190424:0:17239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba0b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625417.190656:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185213440 00000100:00100000:1.0:1788625417.190667:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185213440 00010000:00010000:2.0:1788625417.190879:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7b963 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e537 expref: 6 pid: 17241 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625417.190973:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00100000:2.0:1788625417.191001:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2394:x1875509185213440:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625417.191024:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625417.191032:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7b963 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e537 expref: 6 pid: 17241 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.191048:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7b963 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e537 expref: 6 pid: 17241 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.191080:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7b963 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e537 expref: 6 pid: 17241 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.191112:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99874244ad00) 00010000:00010000:2.0:1788625417.191117:0:17226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba0b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.191129:0:17226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.191138:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba0b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.191185:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625417.191268:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2394:x1875509185213440:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 269us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625417.191276:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 15 00010000:00010000:0.0:1788625417.191333:0:17239:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.191343:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.191376:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21e00/0x2d2e3b3f34a7ba12 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.191399:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21e00/0x2d2e3b3f34a7ba12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.191410:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21e00/0x2d2e3b3f34a7ba12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.198725:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20600/0x2d2e3b3f34a7ba19 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.198754:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20600/0x2d2e3b3f34a7ba19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.198770:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20600/0x2d2e3b3f34a7ba19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625417.198812:0:17239:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6ce2450 reply state 000000006e46c037 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20600/0x2d2e3b3f34a7ba19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.198824:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20600/0x2d2e3b3f34a7ba19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.198852:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:0.0:1788625417.198855:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788625417.198861:0:17239:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788625417.198868:0:17239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788625417.198880:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.198886:0:17239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba0b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.198893:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba0b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.198899:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625417.198903:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba0b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.198912:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba0b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.198922:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99874244ad00) 00010000:00010000:0.0:1788625417.198925:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625417.198929:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba0b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.198935:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba0b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625417.198963:0:17239:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6ce2450 reply state 000000006e46c037 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21e00/0x2d2e3b3f34a7ba12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.198985:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21e00/0x2d2e3b3f34a7ba12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.198991:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9988749c3700) 00010000:00010000:0.0:1788625417.198994:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788625417.198996:0:17239:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788625417.199129:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+10:15613:x1875509185213312:12345-192.168.204.14@tcp:36:lfs.0 Request processed in 14054us (14405us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788625417.199141:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 28 00000100:00100000:2.0:1788625417.296215:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625417.296427:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185213568 00000100:00100000:0.0:1788625417.296452:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185213568 00000100:00100000:0.0:1788625417.296613:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 29 00000100:00100000:0.0:1788625417.296626:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+10:15621:x1875509185213568:12345-192.168.204.14@tcp:101:lctl.0 00010000:00010000:0.0:1788625417.296655:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625417.296680:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20400/0x2d2e3b3f34a7ba20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e561 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.296760:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21400/0x2d2e3b3f34a7ba27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.296777:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21400/0x2d2e3b3f34a7ba27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.296790:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21400/0x2d2e3b3f34a7ba27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625417.296842:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788625417.296847:0:17240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625417.296906:0:17240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21400/0x2d2e3b3f34a7ba27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.296931:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20400/0x2d2e3b3f34a7ba20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e561 expref: 12 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.296952:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21400/0x2d2e3b3f34a7ba27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e561 expref: 11 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.296962:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c3500) 00010000:00010000:0.0:1788625417.296965:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625417.296970:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da21400, rc 0) 00000100:00100000:0.0:1788625417.297043:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+11:15621:x1875509185213568:12345-192.168.204.14@tcp:101:lctl.0 Request processed in 420us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625417.297051:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 29 00000100:00100000:3.0:1788625417.313906:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625417.314027:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185213696 00000100:00100000:2.0:1788625417.314360:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185213696 00000100:00100000:2.0:1788625417.314512:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 30 00000100:00100000:2.0:1788625417.314568:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:15622:x1875509185213696:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625417.314594:0:18690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625417.314619:0:18690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9000/0x2d2e3b3f34a7ba2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e568 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.314703:0:18690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8200/0x2d2e3b3f34a7ba35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.314719:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8200/0x2d2e3b3f34a7ba35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.314731:0:18690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8200/0x2d2e3b3f34a7ba35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625417.314782:0:18690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788625417.314786:0:18690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625417.314808:0:18690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8200/0x2d2e3b3f34a7ba35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.314833:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9000/0x2d2e3b3f34a7ba2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e568 expref: 7 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.314851:0:18690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8200/0x2d2e3b3f34a7ba35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e568 expref: 6 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.314860:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c3500) 00010000:00010000:2.0:1788625417.314862:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625417.314866:0:18690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be8200, rc 0) 00000100:00100000:2.0:1788625417.314941:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:15622:x1875509185213696:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 377us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625417.314957:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 30 00000100:00100000:1.0:1788625417.318041:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625417.319579:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185213824 00000100:00100000:0.0:1788625417.319598:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185213824 00000100:00100000:0.0:1788625417.319863:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 31 00000100:00100000:0.0:1788625417.319877:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:15622:x1875509185213824:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:0.0:1788625417.319910:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625417.319938:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20400/0x2d2e3b3f34a7ba3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e56f expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.320014:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.320038:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.320061:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.320101:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.320111:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.320127:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.320212:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21600/0x2d2e3b3f34a7ba51 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.320233:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21600/0x2d2e3b3f34a7ba51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.320240:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21600/0x2d2e3b3f34a7ba51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625417.320283:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788625417.320287:0:17240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625417.323442:0:17240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21600/0x2d2e3b3f34a7ba51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.323485:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.323492:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba43 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.323501:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.323544:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887da20000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625417.323549:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.323557:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba43 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.323579:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c3500) 00010000:00010000:0.0:1788625417.323582:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625417.323588:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.323594:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.323613:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.323618:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba4a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.323623:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.323628:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887da20200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625417.323630:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.323635:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.324163:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9988749c3700) 00010000:00010000:0.0:1788625417.324167:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625417.324172:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba4a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.324179:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.326726:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20400/0x2d2e3b3f34a7ba3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e56f expref: 8 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.326766:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21600/0x2d2e3b3f34a7ba51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e56f expref: 7 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.326776:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:0.0:1788625417.326780:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625417.326783:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da21600, rc 0) 00000100:00100000:0.0:1788625417.326867:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+7:15622:x1875509185213824:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 6992us (8844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625417.326877:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 31 00000100:00100000:3.0:1788625417.333129:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625417.333227:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185213952 00000100:00100000:2.0:1788625417.333239:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185213952 00000100:00100000:2.0:1788625417.333298:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:2.0:1788625417.333309:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:15622:x1875509185213952:12345-192.168.204.14@tcp:900:lfs.0 00000100:00100000:2.0:1788625417.333412:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:15622:x1875509185213952:12345-192.168.204.14@tcp:900:lfs.0 Request processed in 105us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625417.333425:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:2.0:1788625417.342640:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625417.342835:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185214208 00000100:00100000:0.0:1788625417.342849:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185214208 00000100:00100000:0.0:1788625417.342921:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 32 00000100:00100000:0.0:1788625417.342933:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eda7774-83ed-48ae-a4ab-ef06595559f2+7:15622:x1875509185214208:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:0.0:1788625417.342959:0:17239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625417.342985:0:17239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20400/0x2d2e3b3f34a7ba58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e576 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625417.343139:0:17239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788625417.343274:0:17239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20400/0x2d2e3b3f34a7ba58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e576 expref: 9 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.343292:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c3500) 00010000:00010000:0.0:1788625417.343295:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788625417.343301:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20400/0x2d2e3b3f34a7ba58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e576 expref: 9 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.343317:0:17239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da20400, rc 0) 00000100:00100000:0.0:1788625417.343911:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eda7774-83ed-48ae-a4ab-ef06595559f2+8:15622:x1875509185214208:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 977us (1278us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788625417.343922:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 32 00000100:00100000:1.0:1788625417.353827:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625417.356015:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185214464 00000100:00100000:3.0:1788625417.357059:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185214464 00000100:00100000:2.0:1788625417.357270:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 33 00000100:00100000:2.0:1788625417.357283:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+8:15622:x1875509185214464:12345-192.168.204.14@tcp:36:lfs.0 00010000:00010000:2.0:1788625417.357350:0:17241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625417.357384:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21600/0x2d2e3b3f34a7ba51 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e56f expref: 8 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.357409:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:2.0:1788625417.357416:0:17241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625417.357444:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9000/0x2d2e3b3f34a7ba66 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.357460:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9000/0x2d2e3b3f34a7ba66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.357471:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9000/0x2d2e3b3f34a7ba66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625417.357749:0:17241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000347903ad reply state 0000000075a3bba4 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9000/0x2d2e3b3f34a7ba66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.357779:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9000/0x2d2e3b3f34a7ba66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.357785:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:2.0:1788625417.357788:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788625417.357790:0:17241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788625417.357798:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788625417.357898:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+9:15622:x1875509185214464:12345-192.168.204.14@tcp:36:lfs.0 Request processed in 617us (4082us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788625417.357906:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 33 00000100:00100000:3.0:1788625417.361790:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625417.362308:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185214720 00000100:00100000:1.0:1788625417.362319:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185214720 00000100:00100000:1.0:1788625417.362436:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 2 00000100:00100000:1.0:1788625417.362450:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+9:15622:x1875509185214720:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:1.0:1788625417.362784:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+10:15622:x1875509185214720:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 328us (1003us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788625417.362792:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 2 00000100:00100000:3.0:1788625417.368131:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625417.368411:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185214976 00000100:00100000:2.0:1788625417.368423:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185214976 00000100:00100000:2.0:1788625417.368494:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 34 00000100:00100000:2.0:1788625417.368505:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+10:15622:x1875509185214976:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625417.368573:0:18690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625417.368596:0:18690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7ba6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e57d expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.368754:0:18690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7ba74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.368916:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7ba74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.368932:0:18690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7ba74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.368947:0:18690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.368977:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.368984:0:18690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625417.369116:0:18690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788625417.370439:0:18690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7ba74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.370455:0:18690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7ba74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.370462:0:18690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7ba74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.370468:0:18690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625417.370473:0:18690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7ba74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.370481:0:18690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7ba74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.370496:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c3500) 00010000:00010000:2.0:1788625417.370499:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625417.370504:0:18690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7ba74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.370510:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7ba74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.370555:0:18690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.370561:0:18690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.370566:0:18690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.370571:0:18690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625417.370574:0:18690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.370580:0:18690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.370588:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9988749c3700) 00010000:00010000:2.0:1788625417.370591:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625417.370594:0:18690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.370599:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7ba7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.372930:0:18690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7ba6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e57d expref: 12 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.372959:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c3500) 00010000:00010000:2.0:1788625417.372962:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625417.372993:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7ba6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e57d expref: 12 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.373012:0:18690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be9200, rc 0) 00000100:00100000:2.0:1788625417.373109:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+11:15622:x1875509185214976:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 4605us (4992us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788625417.373118:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 34 00000100:00100000:2.0:1788625417.378117:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625417.378216:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185215104 00000100:00100000:0.0:1788625417.378229:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185215104 00000100:00100000:0.0:1788625417.378305:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 35 00000100:00100000:0.0:1788625417.378316:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+11:15622:x1875509185215104:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:0.0:1788625417.378346:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625417.378374:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20400/0x2d2e3b3f34a7ba89 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e584 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.378505:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba90 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.378552:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.378585:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625417.378618:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788625417.378622:0:17240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625417.380314:0:17240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.380380:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20400/0x2d2e3b3f34a7ba89 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e584 expref: 13 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.380410:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e584 expref: 12 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.380420:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:0.0:1788625417.380423:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625417.380426:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da20200, rc 0) 00000100:00100000:0.0:1788625417.381369:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+12:15622:x1875509185215104:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 3047us (3253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625417.381381:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 35 00000100:00100000:3.0:1788625417.390002:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625417.399398:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185215232 00000100:00100000:0.0:1788625417.399495:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185215232 00000100:00100000:2.0:1788625417.399991:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:2.0:1788625417.400011:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3eda7774-83ed-48ae-a4ab-ef06595559f2+12:15622:x1875509185215232:12345-192.168.204.14@tcp:37:lfs.0 00000100:00100000:2.0:1788625417.414484:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3eda7774-83ed-48ae-a4ab-ef06595559f2+12:15622:x1875509185215232:12345-192.168.204.14@tcp:37:lfs.0 Request processed in 14469us (24481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625417.414499:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:1.0:1788625417.418286:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625417.418389:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185215488 00000100:00100000:2.0:1788625417.418401:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185215488 00000100:00100000:2.0:1788625417.418496:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 4 00000100:00100000:2.0:1788625417.418508:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887c9e5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+12:15622:x1875509185215488:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:2.0:1788625417.418860:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887c9e5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+13:15622:x1875509185215488:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 353us (587us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788625417.418870:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 4 00000100:00100000:2.0:1788625417.483656:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625417.483930:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185215616 00000100:00100000:0.0:1788625417.483945:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185215616 00000100:00100000:0.0:1788625417.484025:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 36 00000100:00100000:0.0:1788625417.484039:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+11:15628:x1875509185215616:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:0.0:1788625417.484079:0:17239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625417.484114:0:17239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20400/0x2d2e3b3f34a7ba97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e58b expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484233:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484250:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484263:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484274:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7baa5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484287:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7baa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484294:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7baa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484401:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21c00/0x2d2e3b3f34a7baac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484411:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21c00/0x2d2e3b3f34a7baac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484418:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21c00/0x2d2e3b3f34a7baac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625417.484455:0:17239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788625417.484459:0:17239:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625417.484504:0:17239:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21c00/0x2d2e3b3f34a7baac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484561:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484569:0:17239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484576:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484582:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887da20000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625417.484587:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484596:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484610:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c3500) 00010000:00010000:0.0:1788625417.484614:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625417.484619:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484625:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7ba9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484642:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7baa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484648:0:17239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7baa5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484653:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7baa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484665:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887da21000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625417.484668:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7baa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484674:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7baa5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484682:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9988749c3700) 00010000:00010000:0.0:1788625417.484684:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625417.484687:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7baa5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484693:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7baa5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484722:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20400/0x2d2e3b3f34a7ba97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e58b expref: 13 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484736:0:17239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21c00/0x2d2e3b3f34a7baac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e58b expref: 12 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.484744:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:0.0:1788625417.484747:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788625417.484749:0:17239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da21c00, rc 0) 00000100:00100000:0.0:1788625417.484826:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+12:15628:x1875509185215616:12345-192.168.204.14@tcp:101:bash.0 Request processed in 790us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625417.484835:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 36 00000100:00100000:3.0:1788625417.491004:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625417.491101:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185215744 00000100:00100000:2.0:1788625417.491112:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185215744 00000100:00100000:2.0:1788625417.491280:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:2.0:1788625417.491292:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:15628:x1875509185215744:12345-192.168.204.14@tcp:900:bash.0 00000100:00100000:2.0:1788625417.491388:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:15628:x1875509185215744:12345-192.168.204.14@tcp:900:bash.0 Request processed in 99us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625417.491411:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:1.0:1788625417.514013:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625417.514227:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185216000 00000100:00100000:2.0:1788625417.514241:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185216000 00000100:00100000:2.0:1788625417.514355:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 37 00000100:00100000:2.0:1788625417.514366:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+12:15628:x1875509185216000:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625417.514389:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625417.514413:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bab3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e592 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.514581:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7baba lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.514600:0:17241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba90 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e584 expref: 12 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.514610:0:17241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7baba lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.514646:0:17241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e584 expref: 12 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.514659:0:17241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba90 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e584 expref: 12 pid: 17240 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625417.514672:0:17241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17241:1875509206264064:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625417.514759:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625417.517789:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625417.517886:0:20265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185216128 00000100:00100000:3.0:1788625417.517896:0:20265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185216128 00010000:00010000:3.0:1788625417.517944:0:20265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba90 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e584 expref: 13 pid: 17240 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625417.517990:0:20265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:3.0:1788625417.518000:0:20265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+13:2393:x1875509185216128:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625417.518016:0:20265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625417.518024:0:20265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba90 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e584 expref: 13 pid: 17240 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.518038:0:20265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba90 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e584 expref: 13 pid: 17240 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.518063:0:20265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:3.0:1788625417.518068:0:20265:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7baba lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.518095:0:20265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7baba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.518104:0:20265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7baba lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625417.518126:0:20265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625417.518197:0:20265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+13:2393:x1875509185216128:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 197us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625417.518205:0:20265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 16 00010000:00010000:2.0:1788625417.519398:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20200/0x2d2e3b3f34a7ba90 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e584 expref: 12 pid: 17240 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625417.519431:0:17241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17241:1875509206264064:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625417.519455:0:17241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7baba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.519465:0:17241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7baba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.519471:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7baba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.519496:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7bac1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.519507:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7bac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.519818:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7bac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.520354:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9c00/0x2d2e3b3f34a7bac8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.520367:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9c00/0x2d2e3b3f34a7bac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.520375:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9c00/0x2d2e3b3f34a7bac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625417.520388:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788625417.520419:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7baba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.520434:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7baba lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.520441:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7baba lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.520447:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625417.520452:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7baba lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.520459:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7baba lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.520473:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:2.0:1788625417.520476:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625417.520481:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7baba lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.520487:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7baba lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625417.520503:0:17241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e977d52 reply state 000000007ac61321 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7bac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.520514:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7bac1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.520565:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff998843c58d00) 00010000:00010000:2.0:1788625417.520567:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625417.520571:0:17241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788625417.520608:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bab3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e592 expref: 15 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.520629:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9c00/0x2d2e3b3f34a7bac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e592 expref: 14 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.520636:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625417.520639:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788625417.520641:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be9c00, rc 0) 00000100:00100000:2.0:1788625417.520727:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+15:15628:x1875509185216000:12345-192.168.204.14@tcp:101:bash.0 Request processed in 6362us (6723us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788625417.520736:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 37 00000100:00100000:0.0:1788625417.537920:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625417.538028:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185216256 00000100:00100000:2.0:1788625417.538040:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185216256 00000100:00100000:2.0:1788625417.538118:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 38 00000100:00100000:2.0:1788625417.538130:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+15:15628:x1875509185216256:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625417.538163:0:18690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625417.538186:0:18690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bad6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e599 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.538261:0:18690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7badd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.538277:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7badd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.538290:0:18690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7badd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625417.538346:0:18690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788625417.538364:0:18690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625417.538392:0:18690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7badd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.538404:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7badd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.538448:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bad6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e599 expref: 17 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.538472:0:18690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7badd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e599 expref: 16 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.538482:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625417.538485:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625417.538489:0:18690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be8000, rc 0) 00000100:00100000:2.0:1788625417.538625:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+16:15628:x1875509185216256:12345-192.168.204.14@tcp:101:bash.0 Request processed in 496us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625417.538632:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 38 00000100:00100000:3.0:1788625417.542605:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625417.542639:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185216512 00000100:00100000:1.0:1788625417.542651:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185216512 00000100:00100000:1.0:1788625417.542712:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 5 00000100:00100000:1.0:1788625417.542723:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+16:15628:x1875509185216512:12345-192.168.204.14@tcp:35:bash.0 00000100:00100000:1.0:1788625417.543061:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+17:15628:x1875509185216512:12345-192.168.204.14@tcp:35:bash.0 Request processed in 338us (469us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788625417.543069:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 5 00010000:00010000:0.0:1788625417.611791:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625417.684622:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625417.685311:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185216768 00000100:00100000:1.0:1788625417.685323:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185216768 00000100:00100000:1.0:1788625417.685392:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 39 00000100:00100000:1.0:1788625417.685404:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+17:15638:x1875509185216768:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625417.685494:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625417.685553:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e5a0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625417.685675:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788625417.685787:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bae4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5a0 expref: 19 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625417.685802:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c3500) 00010000:00010000:1.0:1788625417.685805:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625417.685810:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5a0 expref: 19 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625417.686346:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882045800, rc 0) 00000100:00100000:0.0:1788625417.686612:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+18:15638:x1875509185216768:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 1207us (1997us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788625417.686622:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 39 00000100:00100000:0.0:1788625417.689350:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625417.689600:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185217024 00000100:00100000:2.0:1788625417.689610:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185217024 00000100:00100000:2.0:1788625417.689707:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:2.0:1788625417.689721:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+18:15638:x1875509185217024:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:2.0:1788625417.690017:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+19:15638:x1875509185217024:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 297us (675us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788625417.690025:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:3.0:1788625417.730658:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625417.730889:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185217280 00000100:00100000:2.0:1788625417.730905:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185217280 00000100:00100000:2.0:1788625417.730994:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 40 00000100:00100000:2.0:1788625417.731029:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+19:15641:x1875509185217280:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625417.731064:0:18690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625417.731103:0:18690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7baf2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e5a7 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.731251:0:18690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7baf9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.731267:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7baf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.731280:0:18690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7baf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625417.731291:0:18690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788625417.731409:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7baf2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5a7 expref: 22 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.731442:0:18690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7baf9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5a7 expref: 21 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.731452:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625417.731455:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625417.731459:0:18690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be8c00, rc 0) 00000100:00100000:2.0:1788625417.731586:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+21:15641:x1875509185217280:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 560us (942us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788625417.731594:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 40 00000040:00080000:1.0:1788625417.742579:0:17997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788625417.747045:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625417.747104:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625417.747569:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185217408 00000100:00100000:2.0:1788625417.747581:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185217408 00000100:00100000:2.0:1788625417.747647:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 41 00000100:00100000:2.0:1788625417.747656:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+21:15641:x1875509185217408:12345-192.168.204.14@tcp:54:lfs.0 00010000:00010000:2.0:1788625417.747730:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bb07 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.747748:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bb07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.747762:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bb07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.747934:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bb07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.747941:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bb07 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.747948:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bb07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.747953:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625417.747958:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bb07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.747966:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bb07 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.747980:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625417.747983:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625417.747989:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bb07 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625417.748004:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bb07 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625417.748950:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+21:15641:x1875509185217408:12345-192.168.204.14@tcp:54:lfs.0 Request processed in 1284us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625417.748965:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 41 00000100:00100000:0.0:1788625417.749323:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185217536 00000100:00100000:0.0:1788625417.749334:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185217536 00000100:00100000:0.0:1788625417.749406:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:0.0:1788625417.749417:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+21:2393:x1875509185217536:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625417.749444:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625417.749474:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7baf9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5a7 expref: 21 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625417.749505:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:0.0:1788625417.749511:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625417.749593:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+20:2393:x1875509185217536:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 178us (2487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625417.749602:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:0.0:1788625417.757784:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625417.759703:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185217792 00000100:00100000:1.0:1788625417.759720:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185217792 00000100:00100000:1.0:1788625417.759807:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:1.0:1788625417.759819:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+20:15641:x1875509185217792:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:1.0:1788625417.760146:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+21:15641:x1875509185217792:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 321us (2363us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788625417.760155:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:0.0:1788625417.996033:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625417.996067:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206264192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625417.996188:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625417.996578:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625417.996590:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206264448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625417.996626:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625417.996666:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206264192 00000100:00100000:3.0:1788625417.996674:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206264192 00000100:00100000:3.0:1788625417.996736:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206264448 00000100:00100000:3.0:1788625417.996740:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206264448 00000100:00100000:3.0:1788625417.996758:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788625417.996769:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206264192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788625417.996810:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788625417.996860:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206264192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625417.996868:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788625417.996907:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788625417.996913:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206264448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788625417.996933:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788625417.996967:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206264448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625417.996973:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788625417.997018:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206264448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625417.997143:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206264320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625417.997172:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625417.997212:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206264192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625417.997346:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206264320 00000100:00100000:1.0:1788625417.997351:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206264320 00000100:00100000:1.0:1788625417.997377:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788625417.997384:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206264320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788625417.997396:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788625417.997428:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206264320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625417.997443:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788625417.997477:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625417.997481:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625417.997672:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625417.997683:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206264576:0@lo:400:kworker.0 00000100:00100000:2.0:1788625417.997720:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625417.997785:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206264960:0@lo:400:kworker.0 00000100:00100000:2.0:1788625417.997812:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625417.997850:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625417.997855:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206265088:0@lo:400:kworker.0 00000100:00100000:2.0:1788625417.997880:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625417.997904:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206265088 00000100:00100000:2.0:1788625417.997907:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206265088 00000100:00100000:2.0:1788625417.997943:0:18745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625417.997950:0:18745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206265088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625417.997985:0:18745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206265088:12345-0@lo:400:kworker.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625417.997992:0:18745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625417.998020:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206265088:0@lo:400:kworker.0 00000100:00100000:2.0:1788625417.998059:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206265472:0@lo:400:kworker.0 00000100:00100000:2.0:1788625417.998096:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625417.998125:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206265472 00000100:00100000:2.0:1788625417.998136:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206265472 00000100:00100000:2.0:1788625417.998165:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788625417.998172:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206265472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625417.998206:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206265472:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625417.998212:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788625417.998239:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99874422aa00 x1875509206265472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625417.998251:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206265472:0@lo:400:kworker.0 00000100:00100000:2.0:1788625417.998285:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625417.998292:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206265600:0@lo:400:kworker.0 00000100:00100000:2.0:1788625417.998332:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625417.998430:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206264960 00000100:00100000:0.0:1788625417.998434:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206264960 00000100:00100000:0.0:1788625417.998473:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788625417.998480:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206264960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.998544:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206264960:12345-0@lo:400:kworker.0 Request processed in 64us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625417.998551:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788625417.998572:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206264832:0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.998597:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625417.998616:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206265344:0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.998638:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625417.998666:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206264320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625417.998679:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788625417.998684:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206264704:0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.998707:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625417.998723:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206265216:0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.998746:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625417.998757:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206265728:0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.998792:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625417.998820:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206264960:0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.998835:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206265600 00000100:00100000:0.0:1788625417.998838:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206265600 00000100:00100000:0.0:1788625417.998855:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206264832 00000100:00100000:0.0:1788625417.998857:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206264832 00000100:00100000:0.0:1788625417.998867:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206265344 00000100:00100000:0.0:1788625417.998875:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206265344 00000100:00100000:0.0:1788625417.998889:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206265216 00000100:00100000:0.0:1788625417.998891:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206265216 00000100:00100000:0.0:1788625417.998899:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206265728 00000100:00100000:0.0:1788625417.998902:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206265728 00000100:00100000:0.0:1788625417.998914:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788625417.998920:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206265600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.998953:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206265600:12345-0@lo:400:kworker.0 Request processed in 34us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625417.998959:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788625417.998986:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206265600:0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.999003:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788625417.999008:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206264832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.999039:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206264832:12345-0@lo:400:kworker.0 Request processed in 31us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625417.999045:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788625417.999069:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206264832:0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.999100:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788625417.999106:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206265344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.999139:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206265344:12345-0@lo:400:kworker.0 Request processed in 34us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625417.999145:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788625417.999168:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206265344:0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.999184:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788625417.999190:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206265216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.999231:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206265216:12345-0@lo:400:kworker.0 Request processed in 41us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625417.999238:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788625417.999262:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206265216:0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.999278:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788625417.999285:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206265728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625417.999318:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206265728:12345-0@lo:400:kworker.0 Request processed in 34us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625417.999324:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1788625417.999345:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998872d25c00 x1875509206265728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625417.999355:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206265728:0@lo:400:kworker.0 00000100:00100000:3.0:1788625417.999458:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206264576 00000100:00100000:3.0:1788625417.999464:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206264576 00000100:00100000:3.0:1788625417.999507:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788625417.999544:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3637:x1875509206264576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625417.999596:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3637:x1875509206264576:12345-0@lo:400:kworker.0 Request processed in 82us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625417.999602:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788625417.999638:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206264576:0@lo:400:kworker.0 00000100:00100000:3.0:1788625417.999657:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206264704 00000100:00100000:3.0:1788625417.999661:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206264704 00000100:00100000:3.0:1788625417.999688:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788625417.999695:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206264704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625417.999732:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206264704:12345-0@lo:400:kworker.0 Request processed in 38us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625417.999739:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788625417.999766:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206264704:0@lo:400:kworker.0 00000100:00080000:1.0:1788625417.999902:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625417.999908:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625417.999911:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788625418.065406:0:17273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788625418.077347:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625418.078147:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185218048 00000100:00100000:0.0:1788625418.078162:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185218048 00000100:00080000:1.0:1788625418.078235:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625418.078269:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 42 00000100:00100000:0.0:1788625418.078283:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+21:15672:x1875509185218048:12345-192.168.204.14@tcp:101:cat.0 00010000:00010000:0.0:1788625418.078315:0:18690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625418.078338:0:18690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bb0e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e5ae expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.078470:0:18690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20a00/0x2d2e3b3f34a7bb15 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.078490:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20a00/0x2d2e3b3f34a7bb15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.078555:0:18690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20a00/0x2d2e3b3f34a7bb15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625418.078568:0:18690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788625418.078737:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bb0e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ae expref: 24 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.078757:0:18690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20a00/0x2d2e3b3f34a7bb15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ae expref: 23 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.078767:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:0.0:1788625418.078769:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625418.078773:0:18690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da20a00, rc 0) 00000100:00100000:0.0:1788625418.078852:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+23:15672:x1875509185218048:12345-192.168.204.14@tcp:101:cat.0 Request processed in 573us (1521us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788625418.078860:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 42 00000100:00100000:1.0:1788625418.091055:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625418.091304:0:20265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185218176 00000100:00100000:3.0:1788625418.091327:0:20265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185218176 00000100:00100000:0.0:1788625418.091679:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 1 00000100:00100000:0.0:1788625418.091695:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+23:2393:x1875509185218176:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625418.091716:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625418.091746:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20a00/0x2d2e3b3f34a7bb15 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ae expref: 23 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.091770:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:0.0:1788625418.091777:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625418.091837:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+22:2393:x1875509185218176:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 147us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625418.091858:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 1 00000100:00100000:0.0:1788625418.096005:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625418.096119:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185218432 00000100:00100000:2.0:1788625418.096130:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185218432 00000100:00100000:2.0:1788625418.096213:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00100000:2.0:1788625418.096224:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+22:15672:x1875509185218432:12345-192.168.204.14@tcp:35:cat.0 00000100:00100000:2.0:1788625418.097043:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+23:15672:x1875509185218432:12345-192.168.204.14@tcp:35:cat.0 Request processed in 815us (1045us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788625418.097053:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00100000:1.0:1788625418.200849:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625418.200954:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185218688 00000100:00100000:0.0:1788625418.200973:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185218688 00000100:00100000:0.0:1788625418.201049:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 43 00000100:00100000:0.0:1788625418.201060:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+23:15678:x1875509185218688:12345-192.168.204.14@tcp:101:dd.0 00010000:00010000:0.0:1788625418.201099:0:17239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625418.201129:0:17239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20a00/0x2d2e3b3f34a7bb23 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e5b5 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.201271:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb2a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.201289:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.201314:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625418.201326:0:17239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788625418.201509:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20a00/0x2d2e3b3f34a7bb23 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5b5 expref: 26 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.201570:0:17239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5b5 expref: 25 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.201581:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:0.0:1788625418.201584:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625418.201605:0:17239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da20e00, rc 0) 00000100:00100000:0.0:1788625418.201693:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+25:15678:x1875509185218688:12345-192.168.204.14@tcp:101:dd.0 Request processed in 634us (856us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788625418.201700:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 43 00000100:00100000:0.0:1788625418.204883:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625418.204999:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185218816 00000100:00100000:2.0:1788625418.205011:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185218816 00000100:00100000:2.0:1788625418.205115:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 44 00000100:00100000:2.0:1788625418.205129:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+25:15678:x1875509185218816:12345-192.168.204.14@tcp:101:dd.0 00010000:00010000:2.0:1788625418.205177:0:18690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625418.205208:0:18690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bb38 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e5bc expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.205288:0:18690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7bb3f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.205317:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7bb3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.205335:0:18690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7bb3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.205925:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9200/0x2d2e3b3f34a7bb38 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5bc expref: 27 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.205950:0:18690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7bb3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5bc expref: 26 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.205960:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625418.205963:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788625418.205967:0:18690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998859be8c00, rc 0) 00000100:00100000:2.0:1788625418.206112:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+26:15678:x1875509185218816:12345-192.168.204.14@tcp:101:dd.0 Request processed in 984us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625418.206122:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 44 00000100:00100000:2.0:1788625418.209967:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625418.214470:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625418.214649:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185219200 00000100:00100000:2.0:1788625418.214660:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185219200 00000100:00100000:2.0:1788625418.214728:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 45 00000100:00100000:2.0:1788625418.214738:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+26:15678:x1875509185219200:12345-192.168.204.14@tcp:36:dd.0 00010000:00010000:2.0:1788625418.214814:0:17239:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625418.214865:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8000/0x2d2e3b3f34a7badd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e599 expref: 26 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.214888:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625418.214894:0:17239:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625418.215104:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.215119:0:17239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb2a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5b5 expref: 26 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.215128:0:17239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.215173:0:17239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5b5 expref: 26 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.215189:0:17239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb2a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5b5 expref: 26 pid: 17239 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625418.215206:0:17239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d26300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17239:1875509206265856:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625418.215308:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625418.215369:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185218944 00000100:00100000:0.0:1788625418.215378:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185218944 00010000:00010000:0.0:1788625418.215404:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb2a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5b5 expref: 27 pid: 17239 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625418.215604:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:0.0:1788625418.215614:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+27:2394:x1875509185218944:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625418.215629:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625418.215635:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb2a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5b5 expref: 27 pid: 17239 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.215649:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb2a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5b5 expref: 27 pid: 17239 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.215664:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:0.0:1788625418.215669:0:17225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.215678:0:17225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.215689:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.215723:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625418.215760:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+27:2394:x1875509185218944:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 147us (5805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625418.215781:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 17 00010000:00010000:2.0:1788625418.219010:0:17239:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.14@tcp) returned -22 from blocking AST (req@00000000ac7ed243 x1875509206265856) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb2a lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5b5 expref: 26 pid: 17239 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.219039:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb2a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5b5 expref: 26 pid: 17239 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625418.219085:0:17239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d26300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17239:1875509206265856:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625418.219111:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625418.219120:0:17239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.219130:0:17239:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.219140:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625418.219237:0:17239:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788625418.219291:0:17239:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e590b11 reply state 000000009f36077f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.219321:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.219330:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625418.219333:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625418.219336:0:17239:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625418.219556:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+27:15678:x1875509185219200:12345-192.168.204.14@tcp:36:dd.0 Request processed in 4817us (5097us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788625418.219566:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 45 00000020:00080000:2.0:1788625418.219572:0:17239:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788625418.351782:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625418.354664:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185219456 00000100:00100000:2.0:1788625418.354682:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185219456 00000100:00100000:2.0:1788625418.354763:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:2.0:1788625418.354779:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+27:15678:x1875509185219456:12345-192.168.204.14@tcp:35:dd.0 00000100:00100000:2.0:1788625418.355140:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+28:15678:x1875509185219456:12345-192.168.204.14@tcp:35:dd.0 Request processed in 366us (3369us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788625418.355148:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:1.0:1788625418.604494:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625418.604705:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185219584 00000100:00100000:2.0:1788625418.604717:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185219584 00000100:00100000:2.0:1788625418.604789:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 46 00000100:00100000:2.0:1788625418.604800:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+28:15692:x1875509185219584:12345-192.168.204.14@tcp:101:stat.0 00010000:00010000:2.0:1788625418.604825:0:18690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625418.604850:0:18690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bb4d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e5c3 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.604921:0:18690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bb54 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.604936:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bb54 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.604947:0:18690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bb54 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.604958:0:18690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bb5b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.604964:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bb5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.604970:0:18690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bb5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605361:0:18690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bb62 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605380:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bb62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605388:0:18690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bb62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625418.605431:0:18690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788625418.605435:0:18690:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625418.605472:0:18690:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bb62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605485:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bb62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605493:0:18690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bb54 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605499:0:18690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bb54 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605505:0:18690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bb54 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605510:0:18690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625418.605546:0:18690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bb54 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605864:0:18690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bb54 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605930:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:2.0:1788625418.605940:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625418.605946:0:18690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bb54 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605953:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bb54 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605971:0:18690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bb5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605978:0:18690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bb5b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605984:0:18690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bb5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605989:0:18690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625418.605992:0:18690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bb5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.605998:0:18690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bb5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.606006:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff998843c58d00) 00010000:00010000:2.0:1788625418.606008:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625418.606011:0:18690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bb5b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.606016:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bb5b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.607890:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bb4d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5c3 expref: 30 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.607934:0:18690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bb62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5c3 expref: 29 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.607944:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625418.607946:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625418.607950:0:18690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5c00, rc 0) 00000100:00100000:2.0:1788625418.608042:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+29:15692:x1875509185219584:12345-192.168.204.14@tcp:101:stat.0 Request processed in 3243us (3555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625418.608072:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 46 00010000:00010000:1.0:1788625418.636386:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625418.700877:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625418.700968:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185219840 00000100:00100000:2.0:1788625418.700983:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185219840 00000100:00100000:2.0:1788625418.701053:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 47 00000100:00100000:2.0:1788625418.701076:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+29:15698:x1875509185219840:12345-192.168.204.14@tcp:36:truncate.0 00010000:00010000:2.0:1788625418.701168:0:17240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625418.701201:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bb62 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5c3 expref: 29 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.701225:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625418.701231:0:17240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625418.701441:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bb69 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.701457:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bb69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.701467:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bb69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625418.701590:0:17240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1788625418.701619:0:17240:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8400c77 reply state 00000000133df3b4 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bb69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.702330:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bb69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625418.702342:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625418.702344:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625418.702347:0:17240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625418.702620:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+31:15698:x1875509185219840:12345-192.168.204.14@tcp:36:truncate.0 Request processed in 1555us (1752us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788625418.702629:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 47 00000020:00080000:2.0:1788625418.702645:0:17240:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788625418.935045:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625418.935248:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185219968 00000100:00100000:0.0:1788625418.935263:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185219968 00000100:00100000:0.0:1788625418.935356:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 48 00000100:00100000:0.0:1788625418.935367:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+31:15712:x1875509185219968:12345-192.168.204.14@tcp:101:stat.0 00010000:00010000:0.0:1788625418.935397:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625418.935423:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20a00/0x2d2e3b3f34a7bb70 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e5ca expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.935496:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21800/0x2d2e3b3f34a7bb77 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.935514:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21800/0x2d2e3b3f34a7bb77 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.935569:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21800/0x2d2e3b3f34a7bb77 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.935582:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7bb7e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.935589:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7bb7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.935596:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7bb7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.935836:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb85 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.935847:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.935855:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625418.935910:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788625418.935916:0:17241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625418.935944:0:17241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.935956:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.935964:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21800/0x2d2e3b3f34a7bb77 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.935970:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21800/0x2d2e3b3f34a7bb77 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.935976:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21800/0x2d2e3b3f34a7bb77 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.935981:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887da21800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625418.935985:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21800/0x2d2e3b3f34a7bb77 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.935993:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21800/0x2d2e3b3f34a7bb77 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.936014:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:0.0:1788625418.936017:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625418.936023:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21800/0x2d2e3b3f34a7bb77 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.936029:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21800/0x2d2e3b3f34a7bb77 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.936045:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7bb7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.936051:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7bb7e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.936067:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7bb7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.936072:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887da20800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625418.936075:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7bb7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.936080:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7bb7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.936088:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff998843c58d00) 00010000:00010000:0.0:1788625418.936089:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625418.936093:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7bb7e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.936098:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7bb7e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.936433:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20a00/0x2d2e3b3f34a7bb70 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ca expref: 33 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.936453:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ca expref: 32 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625418.936461:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:0.0:1788625418.936464:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625418.936467:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da20e00, rc 0) 00000100:00100000:0.0:1788625418.936706:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+32:15712:x1875509185219968:12345-192.168.204.14@tcp:101:stat.0 Request processed in 1340us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625418.936714:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 48 00000100:00100000:1.0:1788625419.052294:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625419.052812:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185220224 00000100:00100000:3.0:1788625419.052824:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185220224 00000100:00100000:3.0:1788625419.052955:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 49 00000100:00100000:3.0:1788625419.052966:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+32:15722:x1875509185220224:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625419.052990:0:17239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625419.053015:0:17239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7bb8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e5d1 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625419.053151:0:17239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788625419.053270:0:17239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7bb8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5d1 expref: 34 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625419.053285:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c3500) 00010000:00010000:3.0:1788625419.053288:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788625419.053293:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7bb8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5d1 expref: 34 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625419.053307:0:17239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683800, rc 0) 00000100:00100000:3.0:1788625419.056268:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+33:15722:x1875509185220224:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 3291us (3972us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1788625419.056282:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 49 00000100:00100000:2.0:1788625419.063004:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625419.065956:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185220480 00000100:00100000:0.0:1788625419.065974:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185220480 00000100:00100000:0.0:1788625419.066126:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:0.0:1788625419.066139:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887c9e4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+33:15722:x1875509185220480:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:0.0:1788625419.066415:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887c9e4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+34:15722:x1875509185220480:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 279us (3422us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788625419.066424:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:0.0:1788625419.184764:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625419.184871:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185220736 00000100:00100000:2.0:1788625419.184882:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185220736 00000100:00100000:2.0:1788625419.185094:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 50 00000100:00100000:2.0:1788625419.185105:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+34:15728:x1875509185220736:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625419.185139:0:18690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625419.185164:0:18690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bb9a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e5d8 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.185310:0:18690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.185327:0:18690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9c00/0x2d2e3b3f34a7bac8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e592 expref: 35 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.185356:0:18690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb85 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ca expref: 35 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.185365:0:18690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.185400:0:18690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ca expref: 35 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.185414:0:18690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ca expref: 35 pid: 17241 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625419.185429:0:18690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d26300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18690:1875509206265984:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625419.185596:0:18690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9c00/0x2d2e3b3f34a7bac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e592 expref: 35 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.185606:0:18690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9c00/0x2d2e3b3f34a7bac8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e592 expref: 35 pid: 17241 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625419.185615:0:18690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d25f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18690:1875509206266112:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625419.185639:0:18690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625419.192669:0:18690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d26300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18690:1875509206265984:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625419.192688:0:18690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d25f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18690:1875509206266112:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625419.192720:0:18690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625419.194724:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625419.194898:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185220864 00000100:00100000:2.0:1788625419.194909:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185220864 00010000:00010000:2.0:1788625419.195140:0:17224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ca expref: 36 pid: 17241 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625419.195187:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:2.0:1788625419.195199:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872678450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+36:2394:x1875509185220864:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625419.195217:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625419.195224:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ca expref: 36 pid: 17241 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.195237:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ca expref: 36 pid: 17241 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.195263:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20e00/0x2d2e3b3f34a7bb85 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ca expref: 36 pid: 17241 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.195280:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625419.195284:0:17224:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.195293:0:17224:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.195300:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625419.195422:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872678450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+35:2394:x1875509185220864:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 225us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625419.195448:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:1.0:1788625419.199568:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625419.199736:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185220992 00000100:00100000:0.0:1788625419.199751:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185220992 00010000:00010000:0.0:1788625419.199795:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9c00/0x2d2e3b3f34a7bac8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e592 expref: 35 pid: 17241 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625419.199864:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:0.0:1788625419.199874:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+35:2393:x1875509185220992:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625419.199892:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625419.199900:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9c00/0x2d2e3b3f34a7bac8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e592 expref: 35 pid: 17241 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625419.199915:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9c00/0x2d2e3b3f34a7bac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e592 expref: 35 pid: 17241 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625419.199940:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9c00/0x2d2e3b3f34a7bac8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e592 expref: 35 pid: 17241 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625419.199958:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:0.0:1788625419.199963:0:17225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625419.199987:0:17225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625419.199996:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625419.200028:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625419.200307:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+34:2393:x1875509185220992:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 434us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625419.200316:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 19 00010000:00010000:2.0:1788625419.201434:0:18690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.201449:0:18690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625419.201478:0:18690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1788625419.201745:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bb9a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5d8 expref: 35 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.201766:0:18690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5d8 expref: 34 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.201775:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625419.201777:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788625419.201781:0:18690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5e00, rc 0) 00000100:00100000:2.0:1788625419.201846:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+34:15728:x1875509185220736:12345-192.168.204.14@tcp:101:bash.0 Request processed in 16742us (17089us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1788625419.201855:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 50 00000100:00100000:1.0:1788625419.209085:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625419.209392:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185221248 00000100:00100000:2.0:1788625419.209407:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185221248 00000100:00100000:2.0:1788625419.209495:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 51 00000100:00100000:2.0:1788625419.209506:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+34:15728:x1875509185221248:12345-192.168.204.14@tcp:36:bash.0 00010000:00010000:2.0:1788625419.210655:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7bbaf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.210681:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7bbaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.210705:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7bbaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625419.210767:0:17240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788625419.210800:0:17240:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089bece64 reply state 000000008d606bfc transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7bbaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.210814:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7bbaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.210821:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625419.210823:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625419.210827:0:17240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788625419.211558:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+37:15728:x1875509185221248:12345-192.168.204.14@tcp:36:bash.0 Request processed in 2048us (2491us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788625419.211567:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 51 00000020:00080000:2.0:1788625419.211573:0:17240:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788625419.215193:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625419.216021:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185221376 00000100:00100000:0.0:1788625419.216209:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185221376 00000100:00100000:0.0:1788625419.216290:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 52 00000100:00100000:0.0:1788625419.216303:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+37:15728:x1875509185221376:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:0.0:1788625419.216336:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625419.216688:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7bbb6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e5df expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625419.216754:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7bbb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5df expref: 38 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625419.216767:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7bbb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5df expref: 38 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625419.216786:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:0.0:1788625419.216788:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625419.216793:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da20800, rc 0) 00000100:00100000:0.0:1788625419.216863:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+38:15728:x1875509185221376:12345-192.168.204.14@tcp:101:bash.0 Request processed in 563us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625419.216870:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 52 00000100:00100000:1.0:1788625419.233067:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625419.233215:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185221504 00000100:00100000:3.0:1788625419.233227:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185221504 00000100:00100000:3.0:1788625419.233294:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 53 00000100:00100000:3.0:1788625419.233305:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+38:15728:x1875509185221504:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:3.0:1788625419.233348:0:17239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625419.233374:0:17239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7bbbd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e5e6 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625419.233487:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7bbc4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625419.233504:0:17239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5d8 expref: 39 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625419.233513:0:17239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7bbc4 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625419.233616:0:17239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5d8 expref: 39 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625419.233850:0:17239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5d8 expref: 39 pid: 18690 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625419.233868:0:17239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744838700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17239:1875509206266240:192.168.204.14@tcp:104: 00000100:00100000:3.0:1788625419.233973:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff99874272cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625419.238394:0:17239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744838700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17239:1875509206266240:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625419.238433:0:17239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7bbc4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625419.242249:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625419.242369:0:20265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185221632 00000100:00100000:3.0:1788625419.242381:0:20265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185221632 00010000:00010000:3.0:1788625419.242427:0:20265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5d8 expref: 40 pid: 18690 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625419.242505:0:20265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:3.0:1788625419.242562:0:20265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+40:2394:x1875509185221632:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625419.242581:0:20265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625419.242589:0:20265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5d8 expref: 40 pid: 18690 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625419.242603:0:20265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5d8 expref: 40 pid: 18690 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625419.242645:0:20265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bba1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5d8 expref: 40 pid: 18690 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625419.242670:0:20265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:3.0:1788625419.242676:0:20265:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7bbc4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625419.242687:0:20265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7bbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625419.242695:0:20265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7bbc4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625419.242727:0:20265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625419.242801:0:20265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+39:2394:x1875509185221632:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 286us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625419.242810:0:20265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 20 00010000:00010000:0.0:1788625419.244444:0:17239:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7bbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625419.244463:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7bbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625419.244571:0:17239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788625419.244578:0:17239:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788625419.244601:0:17239:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7bbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625419.244679:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7bbbd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5e6 expref: 39 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625419.244701:0:17239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7bbc4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5e6 expref: 38 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625419.244710:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:0.0:1788625419.244713:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788625419.244717:0:17239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682800, rc 0) 00000100:00100000:0.0:1788625419.244791:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+38:15728:x1875509185221504:12345-192.168.204.14@tcp:101:bash.0 Request processed in 11487us (11747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625419.244799:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 53 00000100:00100000:1.0:1788625419.253343:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625419.253425:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185221888 00000100:00100000:0.0:1788625419.253436:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185221888 00000100:00100000:0.0:1788625419.253510:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 2 00000100:00100000:0.0:1788625419.253558:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+38:15728:x1875509185221888:12345-192.168.204.14@tcp:103:bash.0 00010000:00010000:0.0:1788625419.253576:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788625419.253601:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7bbb6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5df expref: 38 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625419.253632:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7bbc4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5e6 expref: 37 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625419.253643:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:0.0:1788625419.253648:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625419.253697:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+36:15728:x1875509185221888:12345-192.168.204.14@tcp:103:bash.0 Request processed in 178us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625419.253720:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 2 00000100:00100000:1.0:1788625419.263592:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625419.265128:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185222016 00000100:00100000:2.0:1788625419.265147:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185222016 00000100:00100000:2.0:1788625419.265234:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 54 00000100:00100000:2.0:1788625419.265246:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+36:15728:x1875509185222016:12345-192.168.204.14@tcp:58:bash.0 00010000:00010000:2.0:1788625419.265367:0:18690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bbcb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.265389:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bbcb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.265402:0:18690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bbcb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625419.268029:0:18690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625419.270010:0:18690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788625419.270757:0:18690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788625419.271088:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+36:15728:x1875509185222016:12345-192.168.204.14@tcp:58:bash.0 Request processed in 5833us (7495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625419.271105:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 54 00000100:00100000:1.0:1788625419.283447:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625419.287645:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185222144 00000100:00100000:2.0:1788625419.287668:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185222144 00000100:00100000:2.0:1788625419.287910:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 55 00000100:00100000:2.0:1788625419.287924:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+36:15728:x1875509185222144:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625419.287968:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625419.288003:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7bbd2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e5ed expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.288096:0:17240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bbcb lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.288120:0:17240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7bbd2 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ed expref: 37 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.288337:0:17240:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bbcb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.288357:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7bbd2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ed expref: 37 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.288374:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625419.288398:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625419.288404:0:17240:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7bbd2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ed expref: 37 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625419.288413:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4c00, rc 0) 00000100:00100000:2.0:1788625419.288626:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+37:15728:x1875509185222144:12345-192.168.204.14@tcp:101:bash.0 Request processed in 704us (5198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625419.288634:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 55 00010000:00010000:0.0:1788625419.662397:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625420.107930:0:17273:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788625420.107943:0:17273:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788625420.107985:0:17273:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788625420.107998:0:17273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788625420.108221:0:17273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d61880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17273:1875509206266368:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788625420.108578:0:17273:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988582e0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788625420.118280:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625420.118877:0:17273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d61880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17273:1875509206266368:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788625420.119425:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185222272 00000100:00100000:0.0:1788625420.119446:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185222272 00000100:00100000:0.0:1788625420.119681:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00100000:0.0:1788625420.119695:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+37:15730:x1875509185222272:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788625420.119742:0:17241:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788625420.119980:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+37:15730:x1875509185222272:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 Request processed in 286us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625420.119989:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00080000:1.0:1788625420.120135:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625420.131401:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625420.131678:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185222400 00000100:00100000:3.0:1788625420.131710:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185222400 00000100:00100000:3.0:1788625420.131784:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00100000:3.0:1788625420.131797:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+37:15730:x1875509185222400:12345-192.168.204.14@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788625420.132465:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7bbd9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.132492:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7bbd9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.132955:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7bbd9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.137929:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7bbe0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.137964:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7bbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.137983:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7bbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138043:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bbe7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138055:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138063:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625420.138275:0:17239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788625420.138281:0:17239:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625420.138375:0:17239:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138413:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7bbd9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138419:0:17239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7bbd9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138426:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7bbd9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138498:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625420.138504:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7bbd9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138513:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7bbd9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138610:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9988749c3300) 00010000:00010000:2.0:1788625420.138613:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625420.138620:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7bbd9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138627:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682000/0x2d2e3b3f34a7bbd9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138646:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7bbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138653:0:17239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7bbe0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138660:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7bbe0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138672:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625420.138675:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7bbe0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138682:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7bbe0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138691:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff998843c58800) 00010000:00010000:2.0:1788625420.138694:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625420.138697:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7bbe0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138704:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7bbe0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138855:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138862:0:17239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bbe7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138868:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bbe7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138874:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625420.138877:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bbe7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138883:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bbe7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138903:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625420.138905:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625420.138909:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bbe7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.138915:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bbe7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625420.139121:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+37:15730:x1875509185222400:12345-192.168.204.14@tcp:34:lhsmtool_posix.0 Request processed in 7319us (7728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625420.139135:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00100000:1.0:1788625420.143366:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625420.143676:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185222656 00000100:00100000:0.0:1788625420.143692:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185222656 00000100:00100000:0.0:1788625420.143947:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 58 00000100:00100000:0.0:1788625420.143960:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+37:15730:x1875509185222656:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625420.143988:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625420.144016:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21800/0x2d2e3b3f34a7bbee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e5f4 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.144248:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bbf5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.144268:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.144284:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625420.144395:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788625420.144541:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.144551:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bbf5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.144559:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.144565:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887da21200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625420.144571:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.144581:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bbf5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.144594:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:0.0:1788625420.144597:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625420.144603:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bbf5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.144610:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bbf5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.144660:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21800/0x2d2e3b3f34a7bbee lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5f4 expref: 39 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.144672:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9988749c3300) 00010000:00010000:0.0:1788625420.144674:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788625420.144686:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21800/0x2d2e3b3f34a7bbee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5f4 expref: 39 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.144696:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da21800, rc 0) 00000100:00100000:0.0:1788625420.144788:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+38:15730:x1875509185222656:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 831us (1505us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1788625420.146759:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 58 00000100:00100000:1.0:1788625420.147974:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625420.148351:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185222784 00000100:00100000:2.0:1788625420.148366:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185222784 00000100:00100000:2.0:1788625420.148441:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 59 00000100:00100000:2.0:1788625420.148454:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+38:15730:x1875509185222784:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788625420.148509:0:17240:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788625420.148765:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+38:15730:x1875509185222784:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 Request processed in 313us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625420.148775:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 59 00000100:00100000:1.0:1788625420.155123:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625420.155277:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185223040 00000100:00100000:2.0:1788625420.155291:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185223040 00000100:00100000:2.0:1788625420.155451:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 60 00000100:00100000:2.0:1788625420.155465:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+38:15730:x1875509185223040:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625420.155497:0:18690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625420.155577:0:18690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bc03 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e5fb expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788625420.156371:0:18690:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:2.0:1788625420.156391:0:18690:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788625420.156421:0:18690:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788625420.156805:0:18690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7bc0a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.156825:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7bc0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.156839:0:18690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7bc0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.156913:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bc03 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5fb expref: 41 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.156937:0:18690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7bc0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5fb expref: 40 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.156947:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998843c58800) 00010000:00010000:2.0:1788625420.156950:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625420.156954:0:18690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5800, rc 0) 00000100:00100000:2.0:1788625420.157060:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+40:15730:x1875509185223040:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 1598us (1953us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788625420.157070:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 60 00000100:00100000:1.0:1788625420.168167:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625420.168336:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185223296 00000100:00100000:2.0:1788625420.168351:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185223296 00000100:00100000:2.0:1788625420.168442:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 61 00000100:00100000:2.0:1788625420.168456:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+40:15730:x1875509185223296:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788625420.168621:0:17240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625420.168661:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7bc0a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5fb expref: 40 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.168688:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998843c58800) 00010000:00010000:2.0:1788625420.168702:0:17240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788625420.168740:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bc18 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.168758:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bc18 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.168771:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bc18 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.175144:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc1f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf3f1dc24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.175234:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc1f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf3f1dc24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.175248:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc1f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf3f1dc24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.175324:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bc18 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.175332:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bc18 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.175339:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bc18 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.175368:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625420.175374:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bc18 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.175383:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bc18 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.175398:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:2.0:1788625420.175402:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625420.175408:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bc18 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.175415:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7bc18 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.175434:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc1f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf3f1dc24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.175440:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc1f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf3f1dc24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.175446:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc1f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf3f1dc24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.175450:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625420.175452:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc1f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf3f1dc24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.176183:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc1f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf3f1dc24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.176211:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf3f1dc24 (ffff998843c58400) 00010000:00010000:2.0:1788625420.176213:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625420.176217:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc1f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf3f1dc24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.176223:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc1f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf3f1dc24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625420.176353:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+39:15730:x1875509185223296:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 7893us (8200us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625420.176363:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 61 00000100:00100000:1.0:1788625420.183281:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625420.183426:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185223424 00000100:00100000:0.0:1788625420.183442:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185223424 00000100:00100000:0.0:1788625420.183556:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 62 00000100:00100000:0.0:1788625420.183570:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+39:15730:x1875509185223424:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625420.183606:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625420.183647:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21800/0x2d2e3b3f34a7bc26 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e602 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.183887:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bc2d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.183909:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bc2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.183926:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bc2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.184271:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21800/0x2d2e3b3f34a7bc26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e602 expref: 41 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.184300:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bc2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e602 expref: 40 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.184328:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9988749c3f00) 00010000:00010000:0.0:1788625420.184332:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788625420.184337:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da21200, rc 0) 00000100:00100000:0.0:1788625420.184500:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+40:15730:x1875509185223424:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 931us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625420.184509:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 62 00000100:00100000:1.0:1788625420.189104:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625420.189210:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185223680 00000100:00100000:0.0:1788625420.189225:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185223680 00000100:00100000:0.0:1788625420.189314:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 63 00000100:00100000:0.0:1788625420.189328:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+40:15730:x1875509185223680:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788625420.189479:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7bc34 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.189506:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7bc34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.189555:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7bc34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625420.189872:0:17239:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788625420.189885:0:17239:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 541297367187ns, next at 542297363525ns, rc = 0 00000004:00010000:0.0:1788625420.189975:0:17239:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac9c4cba reply state 000000007691c5ce transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7bc34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.189990:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7bc34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.189998:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9988749c3f00) 00010000:00010000:0.0:1788625420.190019:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788625420.190024:0:17239:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788625420.190206:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+42:15730:x1875509185223680:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 880us (1116us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1788625420.190214:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 63 00000100:00100000:1.0:1788625420.193508:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625420.193645:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185223808 00000100:00100000:2.0:1788625420.193674:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185223808 00000100:00100000:2.0:1788625420.193770:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:2.0:1788625420.193782:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+42:15730:x1875509185223808:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625420.193808:0:18690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625420.193967:0:18690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc3b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e609 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.194045:0:18690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e609 expref: 43 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.194062:0:18690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e609 expref: 43 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.194082:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9988749c3f00) 00010000:00010000:2.0:1788625420.194085:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625420.194103:0:18690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5c00, rc 0) 00000100:00100000:2.0:1788625420.194175:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+43:15730:x1875509185223808:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 396us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625420.194182:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:1.0:1788625420.196758:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625420.196963:0:19761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185223936 00000100:00100000:0.0:1788625420.196987:0:19761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185223936 00000100:00080000:1.0:1788625420.197084:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625420.197088:0:19761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:0.0:1788625420.197102:0:19761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2394:x1875509185223936:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788625420.198210:0:19761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2394:x1875509185223936:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 Request processed in 1103us (1458us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788625420.198224:0:19761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:1.0:1788625420.201403:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625420.201585:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185224192 00000100:00100000:2.0:1788625420.201600:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185224192 00000100:00100000:2.0:1788625420.201687:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00100000:2.0:1788625420.201700:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+43:15730:x1875509185224192:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788625420.202080:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+44:15730:x1875509185224192:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 380us (692us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788625420.202089:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00100000:1.0:1788625420.206352:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625420.207415:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185224448 00000100:00100000:2.0:1788625420.207433:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185224448 00000100:00100000:2.0:1788625420.207599:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:2.0:1788625420.207613:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+44:15730:x1875509185224448:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788625420.207825:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+44:15730:x1875509185224448:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 214us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625420.207834:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:3.0:1788625420.211319:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625420.212116:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185224576 00000100:00100000:1.0:1788625420.212135:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185224576 00000100:00100000:1.0:1788625420.212228:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 66 00000100:00100000:1.0:1788625420.212241:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+44:15730:x1875509185224576:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625420.212274:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625420.212310:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bc42 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e610 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.212759:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882044000/0x2d2e3b3f34a7bc49 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.212786:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882044000/0x2d2e3b3f34a7bc49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.212833:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882044000/0x2d2e3b3f34a7bc49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625420.212910:0:17241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625420.212947:0:17241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998882044000/0x2d2e3b3f34a7bc49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.212987:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bc42 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e610 expref: 46 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.213016:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998882044000/0x2d2e3b3f34a7bc49 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e610 expref: 45 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.213026:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9988749c3f00) 00010000:00010000:1.0:1788625420.213041:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788625420.213046:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882044000, rc 0) 00000100:00100000:1.0:1788625420.213155:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+45:15730:x1875509185224576:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 915us (2148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625420.213164:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 66 00000100:00100000:1.0:1788625420.224447:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625420.225424:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185224704 00000100:00100000:0.0:1788625420.225442:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185224704 00000100:00100000:0.0:1788625420.225829:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:0.0:1788625420.225843:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2392:x1875509185224704:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625420.225872:0:19755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625420.225910:0:19755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df6e06fe/0x2d2e3b3f34a7bc50 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e617 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625420.225954:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c420b, blocks: 0x0 00010000:00010000:0.0:1788625420.225985:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=541s v=(0 0) 00010000:00010000:0.0:1788625420.225992:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625420.226005:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df6e06fe/0x2d2e3b3f34a7bc50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e617 expref: 7 pid: 19755 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.226043:0:19755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df6e06fe/0x2d2e3b3f34a7bc50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e617 expref: 7 pid: 19755 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.226089:0:19755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da21800, rc 0) 00000100:00100000:0.0:1788625420.226204:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:2392:x1875509185224704:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 363us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625420.226213:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:3.0:1788625420.233249:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625420.233356:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185224960 00000100:00100000:0.0:1788625420.233373:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185224960 00000100:00100000:0.0:1788625420.233473:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 67 00000100:00100000:0.0:1788625420.233485:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+45:15730:x1875509185224960:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788625420.233682:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+45:15730:x1875509185224960:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 198us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625420.233691:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 67 00000100:00100000:3.0:1788625420.237412:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625420.237562:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185225088 00000100:00100000:2.0:1788625420.237578:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185225088 00000100:00100000:2.0:1788625420.237676:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 68 00000100:00100000:2.0:1788625420.237695:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+45:15730:x1875509185225088:12345-192.168.204.14@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788625420.240553:0:17219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:1.0:1788625420.240581:0:17219:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788625420.240669:0:17219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788625420.240888:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+20:15730:x1875509185225088:12345-192.168.204.14@tcp:44:lhsmtool_posix.0 Request processed in 3189us (3489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625420.240900:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 68 00000100:00100000:1.0:1788625420.241147:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625420.241183:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99886cbfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206266496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788625420.241268:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625420.241572:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9000/0x2d2e3b3f34a7ba66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.241586:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9000/0x2d2e3b3f34a7ba66 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.241599:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9000/0x2d2e3b3f34a7ba66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.241606:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625420.241612:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9000/0x2d2e3b3f34a7ba66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.241622:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9000/0x2d2e3b3f34a7ba66 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.241643:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:2.0:1788625420.241646:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788625420.241652:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9000/0x2d2e3b3f34a7ba66 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.241660:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9000/0x2d2e3b3f34a7ba66 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.241885:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21e00/0x2d2e3b3f34a7ba12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.241894:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21e00/0x2d2e3b3f34a7ba12 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.241900:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21e00/0x2d2e3b3f34a7ba12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.241905:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887da21e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625420.241907:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21e00/0x2d2e3b3f34a7ba12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.241913:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21e00/0x2d2e3b3f34a7ba12 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.241934:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9988749c3700) 00010000:00010000:3.0:1788625420.241936:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625420.241940:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21e00/0x2d2e3b3f34a7ba12 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.241945:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21e00/0x2d2e3b3f34a7ba12 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.241965:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20600/0x2d2e3b3f34a7ba19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.241972:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20600/0x2d2e3b3f34a7ba19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.241977:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20600/0x2d2e3b3f34a7ba19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.241982:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887da20600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625420.241985:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20600/0x2d2e3b3f34a7ba19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.241991:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20600/0x2d2e3b3f34a7ba19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.241998:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:3.0:1788625420.242000:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625420.242003:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20600/0x2d2e3b3f34a7ba19 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.242008:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20600/0x2d2e3b3f34a7ba19 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625420.242653:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206266496 00000100:00100000:0.0:1788625420.242666:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206266496 00000100:00100000:0.0:1788625420.242754:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788625420.242766:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206266496:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788625420.242767:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788625420.243337:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7bac1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.243352:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7bac1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.243359:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7bac1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.243365:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625420.243431:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7bac1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.243443:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7bac1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.243461:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff998843c58d00) 00010000:00010000:3.0:1788625420.243463:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625420.243468:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7bac1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.243476:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be9600/0x2d2e3b3f34a7bac1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.243509:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625420.244832:0:18747:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788625420.244840:0:18747:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788625420.244843:0:18747:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788625420.244850:0:18747:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788625419 -> 1788625419 00002000:00010000:0.0:1788625420.244854:0:18747:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788625420.244993:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206266496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2223us (3719us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788625420.245006:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:1.0:1788625420.245227:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99886cbfca80/2, rc 0, transno 8589934596 00000100:00100000:1.0:1788625420.245237:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99886cbfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206266496:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788625420.245872:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.245881:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.245909:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625420.245915:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.245926:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.245947:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:3.0:1788625420.245950:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625420.245956:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246172:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7bb46 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246196:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bb69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246203:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bb69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246209:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bb69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246214:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625420.246217:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bb69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246223:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bb69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246242:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:3.0:1788625420.246244:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625420.246248:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bb69 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246253:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bb69 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246264:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7bbaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246270:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7bbaf lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246275:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7bbaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246281:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625420.246284:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7bbaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246290:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7bbaf lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246296:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:3.0:1788625420.246298:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625420.246300:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7bbaf lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246305:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7bbaf lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246327:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7bc34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246334:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7bc34 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246340:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7bc34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246345:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887da20000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625420.246347:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7bc34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246353:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7bc34 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246360:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9988749c3f00) 00010000:00010000:3.0:1788625420.246362:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788625420.246365:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7bc34 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.246378:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20000/0x2d2e3b3f34a7bc34 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625420.248484:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625420.250315:0:19761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185225216 00000100:00100000:0.0:1788625420.250368:0:19761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185225216 00000100:00100000:0.0:1788625420.250476:0:19761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:0.0:1788625420.250489:0:19761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:2391:x1875509185225216:12345-192.168.204.14@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788625420.250699:0:19761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:2391:x1875509185225216:12345-192.168.204.14@tcp:16:lhsmtool_posix.0 Request processed in 211us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625420.250708:0:19761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:2.0:1788625420.253578:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625420.254171:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185225472 00000100:00100000:0.0:1788625420.254188:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185225472 00000100:00100000:0.0:1788625420.254282:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 69 00000100:00100000:0.0:1788625420.254295:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+14:15730:x1875509185225472:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788625420.254426:0:17239:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625420.254471:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882044000/0x2d2e3b3f34a7bc49 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e610 expref: 14 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.254500:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9988749c3f00) 00010000:00010000:0.0:1788625420.254506:0:17239:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625420.254616:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7bc57 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.254637:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7bc57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.254655:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7bc57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788625420.254853:0:17239:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040c3a3c2 reply state 000000006ef19f8b transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7bc57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.254867:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7bc57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.254882:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9988749c3f00) 00010000:00010000:0.0:1788625420.254884:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788625420.254887:0:17239:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788625420.255071:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+15:15730:x1875509185225472:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 778us (1557us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788625420.255080:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 69 00000100:00100000:2.0:1788625420.263631:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625420.266381:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185225600 00000100:00100000:3.0:1788625420.266414:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185225600 00000100:00100000:3.0:1788625420.266605:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:3.0:1788625420.266620:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998845b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:15730:x1875509185225600:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788625420.266654:0:19755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625420.266690:0:19755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000748a966/0x2d2e3b3f34a7bc5e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e61e expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.266773:0:19755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df6e06fe/0x2d2e3b3f34a7bc50 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e617 expref: 8 pid: 19755 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.266784:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625420.266790:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625420.266798:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000748a966/0x2d2e3b3f34a7bc5e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e61e expref: 8 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.266850:0:19755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df6e06fe/0x2d2e3b3f34a7bc50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e617 expref: 8 pid: 19755 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.268333:0:19755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df6e06fe/0x2d2e3b3f34a7bc50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e617 expref: 8 pid: 19755 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625420.268357:0:19755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744839c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19755:1875509206266624:192.168.204.14@tcp:104: 00000100:00100000:3.0:1788625420.268691:0:19755:0:(client.c:2716:ptlrpc_set_wait()) set ffff99874272cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625420.275842:0:19755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744839c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19755:1875509206266624:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625420.275907:0:19755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000748a966/0x2d2e3b3f34a7bc5e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e61e expref: 8 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.275938:0:19755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683e00, rc 0) 00000100:00100000:0.0:1788625420.278393:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998845b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+8:15730:x1875509185225600:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 11741us (14748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625420.278412:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:3.0:1788625420.280287:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625420.280440:0:20265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185225728 00000100:00100000:0.0:1788625420.280454:0:20265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185225728 00010000:00010000:0.0:1788625420.280857:0:20265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df6e06fe/0x2d2e3b3f34a7bc50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e617 expref: 8 pid: 19755 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625420.280928:0:20265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:0.0:1788625420.280946:0:20265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+8:2393:x1875509185225728:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625420.281056:0:20265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625420.281366:0:20265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df6e06fe/0x2d2e3b3f34a7bc50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e617 expref: 8 pid: 19755 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.281483:0:20265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df6e06fe/0x2d2e3b3f34a7bc50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e617 expref: 8 pid: 19755 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.281748:0:20265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df6e06fe/0x2d2e3b3f34a7bc50 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e617 expref: 8 pid: 19755 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.281773:0:20265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625420.281778:0:20265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625420.281786:0:20265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000748a966/0x2d2e3b3f34a7bc5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e61e expref: 7 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.281799:0:20265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000748a966/0x2d2e3b3f34a7bc5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e61e expref: 7 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.284116:0:20265:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000748a966/0x2d2e3b3f34a7bc5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e61e expref: 7 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625420.284154:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99886cbfd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:20265:1875509206266752:192.168.204.14@tcp:105: 00000100:00100000:0.0:1788625420.284305:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bc180 going to sleep for 11 seconds 00000100:00100000:0.0:1788625420.288371:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99886cbfd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:20265:1875509206266752:192.168.204.14@tcp:105: 00010000:00010000:0.0:1788625420.288429:0:20265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625420.288562:0:20265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:2393:x1875509185225728:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 7571us (8241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625420.288607:0:20265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:3.0:1788625420.291045:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625420.291129:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185225856 00000100:00100000:0.0:1788625420.291141:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185225856 00000100:00100000:0.0:1788625420.291230:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:0.0:1788625420.291243:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:2391:x1875509185225856:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788625420.291657:0:18747:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788625420.291662:0:18747:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788625418 00002000:00010000:0.0:1788625420.291664:0:18747:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788625416 00002000:00010000:0.0:1788625420.291666:0:18747:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788625419 -> 1788625418 00002000:00010000:0.0:1788625420.291669:0:18747:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788625420.291763:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+8:2391:x1875509185225856:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 Request processed in 521us (745us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788625420.291773:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:1.0:1788625420.295944:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625420.296595:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185225984 00000100:00100000:2.0:1788625420.296612:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185225984 00000100:00100000:2.0:1788625420.296820:0:18745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 26 00000100:00100000:2.0:1788625420.296834:0:18745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+8:2391:x1875509185225984:12345-192.168.204.14@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788625420.296913:0:18745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7bc65 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.296945:0:18745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000748a966/0x2d2e3b3f34a7bc5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e61e expref: 8 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.296995:0:18745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625420.297000:0:18745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788625420.297006:0:18745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7bc65 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.297067:0:18745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000748a966/0x2d2e3b3f34a7bc5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e61e expref: 8 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.297086:0:18745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000748a966/0x2d2e3b3f34a7bc5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e61e expref: 8 pid: 19755 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625420.297113:0:18745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d25f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18745:1875509206266880:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625420.297238:0:18745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788625420.305996:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625420.306242:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185226112 00000100:00100000:0.0:1788625420.306254:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185226112 00010000:00010000:0.0:1788625420.306312:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000748a966/0x2d2e3b3f34a7bc5e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e61e expref: 9 pid: 19755 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625420.306375:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 22 00000100:00100000:0.0:1788625420.306388:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+9:2394:x1875509185226112:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625420.306412:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625420.306448:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000748a966/0x2d2e3b3f34a7bc5e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e61e expref: 9 pid: 19755 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.306466:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000748a966/0x2d2e3b3f34a7bc5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e61e expref: 9 pid: 19755 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.306586:0:17225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788625420.306593:0:17225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788625420.306600:0:17225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7bc65 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.306614:0:17225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7bc65 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.306647:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625420.306721:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+9:2394:x1875509185226112:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 334us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625420.306730:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 22 00010000:00010000:2.0:1788625420.307628:0:18745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000748a966/0x2d2e3b3f34a7bc5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e61e expref: 8 pid: 19755 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625420.307653:0:18745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d25f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18745:1875509206266880:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625420.307686:0:18745:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7bc65 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.307699:0:18745:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7bc65 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.307736:0:18745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7bc65 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.307770:0:18745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7bc65 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.307781:0:18745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7bc65 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.307790:0:18745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7bc65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.307798:0:18745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625420.307803:0:18745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7bc65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.307813:0:18745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7bc65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.307831:0:18745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7bc65 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.307839:0:18745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c27b78b1/0x2d2e3b3f34a7bc65 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625420.309464:0:18745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:2391:x1875509185225984:12345-192.168.204.14@tcp:1:lhsmtool_posix.0 Request processed in 12613us (13523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625420.309483:0:18745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 26 00000100:00100000:3.0:1788625420.312494:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625420.312781:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185226368 00000100:00100000:1.0:1788625420.312798:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185226368 00000100:00100000:1.0:1788625420.312887:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 70 00000100:00100000:1.0:1788625420.312900:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+15:15730:x1875509185226368:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788625420.313053:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc6c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.313078:0:17241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7bb3f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5bc expref: 15 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.313089:0:17241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc6c lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.313329:0:17241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7bb3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5bc expref: 15 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.313346:0:17241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7bb3f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5bc expref: 15 pid: 18690 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625420.313367:0:17241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17241:1875509206267008:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625420.313726:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988582e0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625420.318881:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625420.319025:0:17241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17241:1875509206267008:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625420.319074:0:17241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc6c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625420.319092:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185226496 00000100:00100000:2.0:1788625420.319109:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185226496 00010000:00010000:2.0:1788625420.319160:0:17224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7bb3f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5bc expref: 16 pid: 18690 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625420.319209:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:2.0:1788625420.319221:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+16:2394:x1875509185226496:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625420.319243:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625420.319252:0:17224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7bb3f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5bc expref: 16 pid: 18690 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.319266:0:17224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7bb3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5bc expref: 16 pid: 18690 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.319309:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8c00/0x2d2e3b3f34a7bb3f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5bc expref: 16 pid: 18690 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.319336:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:2.0:1788625420.319342:0:17224:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7bbd2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ed expref: 15 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.319355:0:17224:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc6c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.319381:0:17224:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.319390:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc6c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.319437:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625420.319513:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+15:2394:x1875509185226496:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 293us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625420.319561:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 23 00010000:00010000:1.0:1788625420.320401:0:17241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.320414:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.320742:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bc73 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.320765:0:17241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc3b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e609 expref: 15 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.320774:0:17241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bc73 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.320823:0:17241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e609 expref: 15 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.320841:0:17241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc3b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e609 expref: 15 pid: 18690 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625420.320860:0:17241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17241:1875509206267136:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625420.320964:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433bf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625420.331423:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625420.332793:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185226624 00000100:00100000:0.0:1788625420.332818:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185226624 00010000:00010000:0.0:1788625420.332905:0:17225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc3b lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e609 expref: 16 pid: 18690 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625420.333042:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:0.0:1788625420.333056:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887267b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+16:2393:x1875509185226624:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625420.333079:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625420.333087:0:17225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc3b lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e609 expref: 16 pid: 18690 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.333136:0:17225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc3b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e609 expref: 16 pid: 18690 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.333173:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9988749c3f00) 00010000:00010000:0.0:1788625420.333181:0:17225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bc73 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.333194:0:17225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bc73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.333203:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bc73 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625420.333236:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625420.333363:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887267b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+16:2393:x1875509185226624:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 309us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625420.333372:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 24 00010000:00010000:1.0:1788625420.333581:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7bc3b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e609 expref: 15 pid: 18690 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625420.333606:0:17241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17241:1875509206267136:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625420.333640:0:17241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bc73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.333664:0:17241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bc73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.333670:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bc73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625420.333870:0:17241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1788625420.334040:0:17241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1788625420.334101:0:17241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1788625420.334221:0:17241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17241:1875509206267264:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788625420.334295:0:17241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625420.334343:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742c64b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625420.334358:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206267264 00000100:00100000:2.0:1788625420.334368:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206267264 00000100:00100000:2.0:1788625420.334426:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788625420.334440:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17241:x1875509206267264:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788625420.334582:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17241:x1875509206267264:12345-0@lo:1000:mdt00_002.0 Request processed in 146us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625420.334591:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788625420.334934:0:17241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17241:1875509206267264:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788625420.335181:0:17241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1788625420.335252:0:17241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17241:1875509206267392:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788625420.335293:0:17241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625420.335320:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625420.335332:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206267392 00000100:00100000:2.0:1788625420.335339:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206267392 00000100:00100000:2.0:1788625420.335380:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788625420.335389:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17241:x1875509206267392:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788625420.335559:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17241:x1875509206267392:12345-0@lo:1000:mdt00_002.0 Request processed in 171us (264us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788625420.335567:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788625420.335806:0:17241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17241:1875509206267392:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788625420.335848:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bc73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.335859:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bc73 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.335867:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bc73 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.335874:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882044800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625420.335898:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bc73 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.335909:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bc73 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.335930:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9988749c3f00) 00010000:00010000:1.0:1788625420.335933:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625420.335939:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bc73 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.335947:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bc73 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.335999:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bbcb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.336007:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bbcb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.336013:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bbcb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.336020:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625420.336023:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bbcb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.336039:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bbcb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.336049:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:1.0:1788625420.336052:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625420.336068:0:17241:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7bbd2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ed expref: 18 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.336095:0:17241:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7bbd2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ed expref: 18 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.336109:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7bbd2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ed expref: 18 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.336182:0:17241:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7bbd2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ed expref: 18 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625420.336197:0:17241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17241:1875509206267520:192.168.204.14@tcp:105: 00000100:00100000:1.0:1788625420.336287:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788625420.339724:0:17241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17241:1875509206267520:192.168.204.14@tcp:105: 00010000:00010000:1.0:1788625420.339771:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bbcb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.339786:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4000/0x2d2e3b3f34a7bbcb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.339838:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7bc7a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.339856:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7bc7a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.339875:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7bc7a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.339920:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7bc7a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.339927:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7bc7a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.339936:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7bc7a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.339944:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882045a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625420.339950:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7bc7a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.339959:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7bc7a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.339992:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:1.0:1788625420.339997:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625420.340001:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7bc7a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.340008:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7bc7a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.340023:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.340041:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc6c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.340049:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.340060:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882045e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625420.340063:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.340070:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc6c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.340078:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:1.0:1788625420.340092:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788625420.340096:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc6c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.340102:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc6c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625420.340597:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+18:15730:x1875509185226368:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 27696us (28114us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1788625420.340611:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 70 00000020:00080000:1.0:1788625420.340620:0:17241:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788625420.340667:0:17273:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788625420.340674:0:17273:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625420.340700:0:17273:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788625420.340714:0:17273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788625420.341857:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625420.341941:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185226752 00000100:00100000:1.0:1788625420.341954:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185226752 00000100:00100000:1.0:1788625420.342022:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00100000:1.0:1788625420.342046:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+18:15728:x1875509185226752:12345-192.168.204.14@tcp:49:bash.0 00000100:00100000:1.0:1788625420.342486:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+18:15728:x1875509185226752:12345-192.168.204.14@tcp:49:bash.0 Request processed in 441us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625420.342495:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00100000:3.0:1788625420.343242:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625420.343461:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185227008 00000100:00100000:1.0:1788625420.343471:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185227008 00000100:00100000:1.0:1788625420.343571:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 13 00000100:00100000:1.0:1788625420.343583:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+18:15730:x1875509185227008:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788625420.344077:0:17243:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788625420.344301:0:17243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1788625420.344363:0:17243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bc81 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.344466:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bc81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.344486:0:17243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bc81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.344496:0:17243:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bc81 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.344503:0:17243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bc81 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.344511:0:17243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bc81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.344592:0:17243:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788625420.344743:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+20:15730:x1875509185227008:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 1158us (1501us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1788625420.344754:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 13 00000020:00080000:1.0:1788625420.344760:0:17243:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788625420.345407:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625420.345421:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bc81 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.345432:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882045800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625420.345439:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bc81 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.345450:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bc81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.345471:0:17227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9988749c3f00) 00010000:00010000:3.0:1788625420.345475:0:17227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788625420.345483:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bc81 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.345489:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882045800/0x2d2e3b3f34a7bc81 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625420.345510:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625420.345512:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625420.345558:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625420.345788:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625420.345866:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185227136 00000100:00100000:1.0:1788625420.345878:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185227136 00000100:00100000:1.0:1788625420.345940:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 27 00000100:00100000:1.0:1788625420.345951:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+7:15728:x1875509185227136:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:1.0:1788625420.346003:0:19755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625420.346039:0:19755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce7d7c35/0x2d2e3b3f34a7bc88 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e625 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625420.346078:0:19755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9c420a, atime: 0x6a9c4208, ctime: 0x6a9c420a, blocks: 0x0 00010000:00010000:1.0:1788625420.346230:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1788625420.346237:0:19755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625420.346251:0:19755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7d7c35/0x2d2e3b3f34a7bc88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e625 expref: 8 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.346271:0:19755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce7d7c35/0x2d2e3b3f34a7bc88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e625 expref: 8 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.346284:0:19755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882044000, rc 0) 00000100:00100000:1.0:1788625420.346353:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+8:15728:x1875509185227136:12345-192.168.204.14@tcp:101:bash.0 Request processed in 403us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625420.346361:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 27 00000100:00100000:0.0:1788625420.351152:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625420.351283:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185227264 00000100:00100000:1.0:1788625420.351299:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185227264 00000100:00100000:1.0:1788625420.351399:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 71 00000100:00100000:1.0:1788625420.351412:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+20:15728:x1875509185227264:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:1.0:1788625420.351453:0:17239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625420.351483:0:17239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc8f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e62c expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.351578:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7bc96 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.351620:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7bc96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.351637:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7bc96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.351796:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bc8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e62c expref: 22 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.351818:0:17239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7bc96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e62c expref: 21 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.351828:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:1.0:1788625420.351831:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788625420.351836:0:17239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998882045a00, rc 0) 00000100:00100000:1.0:1788625420.351928:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+21:15728:x1875509185227264:12345-192.168.204.14@tcp:101:bash.0 Request processed in 517us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625420.351942:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 71 00000100:00100000:3.0:1788625420.355966:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625420.356624:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185227520 00000100:00100000:1.0:1788625420.356639:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185227520 00000100:00100000:1.0:1788625420.356987:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00100000:1.0:1788625420.357005:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+21:15728:x1875509185227520:12345-192.168.204.14@tcp:35:bash.0 00000001:00080000:1.0:1788625420.357374:0:17243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:1.0:1788625420.357504:0:17243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:1.0:1788625420.357695:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+24:15728:x1875509185227520:12345-192.168.204.14@tcp:35:bash.0 Request processed in 694us (1745us total) trans 8589934633 rc 0/0 00000100:00100000:1.0:1788625420.357705:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 14 00000020:00080000:1.0:1788625420.357719:0:17243:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788625420.464078:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625420.464225:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185227776 00000100:00100000:2.0:1788625420.464241:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185227776 00000100:00100000:2.0:1788625420.464341:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 72 00000100:00100000:2.0:1788625420.464353:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+24:15740:x1875509185227776:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625420.464391:0:18690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625420.464421:0:18690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bc9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e633 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625420.464648:0:18690:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788625420.464792:0:18690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bc9d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e633 expref: 26 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.464810:0:18690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c3500) 00010000:00010000:2.0:1788625420.464813:0:18690:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625420.464820:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7bc9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e633 expref: 26 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625420.464844:0:18690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4600, rc 0) 00000100:00100000:2.0:1788625420.464934:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+25:15740:x1875509185227776:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 582us (873us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1788625420.464942:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 72 00000100:00100000:0.0:1788625420.473943:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625420.474402:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185227904 00000100:00100000:1.0:1788625420.474419:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185227904 00000100:00100000:1.0:1788625420.474734:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 73 00000100:00100000:1.0:1788625420.474747:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+25:15740:x1875509185227904:12345-192.168.204.14@tcp:34:lfs.0 00010000:00010000:1.0:1788625420.474869:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bcab lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.474893:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bcab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.474911:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bcab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.474931:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bcb2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.474938:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bcb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.474945:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bcb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475411:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882044400/0x2d2e3b3f34a7bcb9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475434:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998882044400/0x2d2e3b3f34a7bcb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475444:0:17239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998882044400/0x2d2e3b3f34a7bcb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625420.475554:0:17239:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998882044400/0x2d2e3b3f34a7bcb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475602:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bcab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475610:0:17239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bcab lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475617:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bcab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475624:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882045e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625420.475630:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bcab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475639:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bcab lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475656:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:1.0:1788625420.475660:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625420.475667:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bcab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475675:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882045e00/0x2d2e3b3f34a7bcab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475696:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bcb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475702:0:17239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bcb2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475707:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bcb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475724:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882044800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625420.475727:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bcb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475734:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bcb2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475742:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9987410b4d00) 00010000:00010000:1.0:1788625420.475744:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625420.475746:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bcb2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475753:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882044800/0x2d2e3b3f34a7bcb2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475771:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998882044400/0x2d2e3b3f34a7bcb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475778:0:17239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998882044400/0x2d2e3b3f34a7bcb9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475783:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998882044400/0x2d2e3b3f34a7bcb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475788:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882044400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625420.475791:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882044400/0x2d2e3b3f34a7bcb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475795:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998882044400/0x2d2e3b3f34a7bcb9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475815:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:1.0:1788625420.475817:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625420.475820:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998882044400/0x2d2e3b3f34a7bcb9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625420.475826:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882044400/0x2d2e3b3f34a7bcb9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625420.476036:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+25:15740:x1875509185227904:12345-192.168.204.14@tcp:34:lfs.0 Request processed in 1277us (2097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625420.476048:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 73 00000100:00100000:3.0:1788625420.482051:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625420.482225:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185228160 00000100:00100000:2.0:1788625420.482243:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185228160 00000100:00100000:2.0:1788625420.482343:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00100000:2.0:1788625420.482358:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+25:15740:x1875509185228160:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:2.0:1788625420.483148:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+26:15740:x1875509185228160:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 788us (1125us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788625420.483159:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00100000:2.0:1788625420.556176:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625420.556214:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206267648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625420.556330:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625420.556555:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206267648 00000100:00100000:3.0:1788625420.556569:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206267648 00000100:00100000:3.0:1788625420.556653:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788625420.556665:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206267648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788625420.556738:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788625420.556814:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206267648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625420.556840:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788625420.556900:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206267648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625420.557184:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625420.557199:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99886cbfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206267776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788625420.557239:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625420.557314:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206267776 00000100:00100000:0.0:1788625420.557320:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206267776 00000100:00100000:0.0:1788625420.557376:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788625420.557385:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206267776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625420.557416:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788625420.557473:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206267776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625420.557481:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788625420.557563:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99886cbfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206267776:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788625420.557709:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788625420.685139:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625421.067956:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206267904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625421.068112:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625421.068765:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206267904 00000100:00100000:2.0:1788625421.068777:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206267904 00000100:00100000:2.0:1788625421.068866:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788625421.068879:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206267904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788625421.068951:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788625421.069045:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206267904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625421.069055:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788625421.069700:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206267904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625421.317278:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625421.317319:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625421.317455:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185228288 00000100:00100000:3.0:1788625421.317468:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185228288 00000100:00100000:3.0:1788625421.317547:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 167 00000100:00100000:3.0:1788625421.317559:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:2394:x1875509185228288:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625421.317707:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:2394:x1875509185228288:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 149us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625421.317716:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 167 00000100:00100000:3.0:1788625421.320019:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625421.320069:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625421.320120:0:19761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185228800 00000100:00100000:2.0:1788625421.320131:0:19761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185228800 00000100:00100000:2.0:1788625421.320197:0:19761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:2.0:1788625421.320206:0:19761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2577c14b-df6c-4b8f-a20a-0ae385000d2e+8:2394:x1875509185228800:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625421.320293:0:19761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2577c14b-df6c-4b8f-a20a-0ae385000d2e+8:2394:x1875509185228800:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 87us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625421.320301:0:19761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:3.0:1788625421.323642:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625421.323687:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625421.323704:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625421.323722:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625421.324496:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625421.324567:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185228544 00000100:00100000:3.0:1788625421.324663:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185228544 00000100:00100000:3.0:1788625421.324739:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185229056 00000100:00100000:3.0:1788625421.324743:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185229056 00000100:00100000:3.0:1788625421.324761:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185228416 00000100:00100000:3.0:1788625421.324763:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185228416 00000100:00100000:3.0:1788625421.324774:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185228928 00000100:00100000:3.0:1788625421.324777:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185228928 00000100:00100000:3.0:1788625421.324795:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:3.0:1788625421.324805:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2394:x1875509185228544:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625421.324891:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2394:x1875509185228544:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 88us (7571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625421.324906:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:3.0:1788625421.324928:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:3.0:1788625421.324935:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2394:x1875509185229056:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625421.324961:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2394:x1875509185229056:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 27us (4892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625421.324967:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:3.0:1788625421.324979:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 66 00000100:00100000:3.0:1788625421.324985:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+26:2394:x1875509185228416:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625421.324985:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 67 00000100:00100000:0.0:1788625421.325000:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185229312 00000100:00100000:0.0:1788625421.325004:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185229312 00000100:00100000:3.0:1788625421.325026:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+26:2394:x1875509185228416:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 41us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625421.325033:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 66 00000100:00100000:0.0:1788625421.325045:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185228672 00000100:00100000:0.0:1788625421.325049:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185228672 00000100:00100000:0.0:1788625421.325067:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185229184 00000100:00100000:0.0:1788625421.325070:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185229184 00000100:00100000:0.0:1788625421.325086:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:0.0:1788625421.325093:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2394:x1875509185229312:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625421.325992:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2394:x1875509185229312:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 892us (2418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625421.326003:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:0.0:1788625421.326037:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 22 00000100:00100000:0.0:1788625421.326046:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2394:x1875509185228672:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625421.326089:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2394:x1875509185228672:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 45us (2384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625421.326096:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 22 00000100:00100000:0.0:1788625421.326108:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:0.0:1788625421.326115:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2394:x1875509185229184:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625421.326218:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2394:x1875509185229184:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 102us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625421.326225:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:0.0:1788625421.326246:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2394:x1875509185228928:12345-192.168.204.14@tcp:400:kworker.0 00000100:00080000:3.0:1788625421.326259:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625421.326264:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625421.326267:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625421.326269:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625421.326286:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2394:x1875509185228928:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 1294us (2563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625421.326292:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 67 00010000:00010000:0.0:1788625421.708950:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788625422.114574:0:20415:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:0.0:1788625422.731803:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625423.115705:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625423.115734:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206268032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625423.115827:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625423.116909:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206268544:0@lo:400:kworker.0 00000100:00100000:0.0:1788625423.116970:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625423.117013:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206269056:0@lo:400:kworker.0 00000100:00100000:0.0:1788625423.117034:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625423.117063:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206269568:0@lo:400:kworker.0 00000100:00100000:0.0:1788625423.117086:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625423.117108:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788625423.117114:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206268416:0@lo:400:kworker.0 00000100:00100000:0.0:1788625423.117142:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625423.117160:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206268928:0@lo:400:kworker.0 00000100:00100000:0.0:1788625423.117178:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625423.117194:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206269440:0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.117633:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206268288:0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.117667:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625423.117696:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206268800:0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.117715:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625423.117728:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206269312:0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.117744:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625423.117760:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788625423.117765:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3638:1875509206268160:0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.119413:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625423.119461:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206268672:0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.119493:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625423.119542:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206269184:0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.119566:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625423.119599:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206268288 00000100:00100000:2.0:1788625423.119607:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206268288 00000100:00100000:2.0:1788625423.119653:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206268672 00000100:00100000:2.0:1788625423.119656:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206268672 00000100:00100000:2.0:1788625423.119670:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788625423.119678:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206268288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.119732:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206268288:12345-0@lo:400:kworker.0 Request processed in 54us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625423.119739:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788625423.119756:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788625423.119762:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206268672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.119788:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206268672:12345-0@lo:400:kworker.0 Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625423.119800:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788625423.119821:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206268416 00000100:00100000:2.0:1788625423.119832:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206268416 00000100:00100000:2.0:1788625423.119875:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206268928 00000100:00100000:2.0:1788625423.119879:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206268928 00000100:00100000:2.0:1788625423.119896:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206268800 00000100:00100000:2.0:1788625423.119899:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206268800 00000100:00100000:2.0:1788625423.119914:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788625423.119919:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206268416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.119951:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206268416:12345-0@lo:400:kworker.0 Request processed in 32us (2808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625423.119957:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788625423.119968:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625423.119985:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206268928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.120016:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206268928:12345-0@lo:400:kworker.0 Request processed in 43us (2838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625423.120023:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625423.120034:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788625423.120039:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206268800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.120064:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206268800:12345-0@lo:400:kworker.0 Request processed in 26us (2349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625423.120070:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788625423.120135:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625423.120164:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206268032 00000100:00100000:0.0:1788625423.120168:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206268032 00000100:00080000:2.0:1788625423.120237:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625423.120240:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206268544 00000100:00080000:2.0:1788625423.120244:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625423.120247:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206268544 00000100:00100000:3.0:1788625423.120277:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206269056 00000100:00100000:3.0:1788625423.120280:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206269056 00000100:00100000:2.0:1788625423.120293:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206268672:0@lo:400:kworker.0 00000100:00100000:3.0:1788625423.120294:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206269568 00000100:00100000:3.0:1788625423.120298:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206269568 00000100:00100000:2.0:1788625423.120316:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206268288:0@lo:400:kworker.0 00000100:00100000:3.0:1788625423.120324:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206269312 00000100:00100000:3.0:1788625423.120329:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206269312 00000100:00100000:2.0:1788625423.120335:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206268800:0@lo:400:kworker.0 00000100:00100000:3.0:1788625423.120346:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206269184 00000100:00100000:3.0:1788625423.120356:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206269184 00000100:00100000:3.0:1788625423.120374:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206269440 00000100:00080000:2.0:1788625423.120375:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625423.120376:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206269440 00000100:00080000:2.0:1788625423.120389:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625423.120395:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788625423.120404:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206268544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625423.120453:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206268544:12345-0@lo:400:kworker.0 Request processed in 50us (3482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625423.120460:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788625423.120471:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788625423.120477:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206269056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625423.120547:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206269056:12345-0@lo:400:kworker.0 Request processed in 28us (3470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625423.120555:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788625423.120578:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788625423.120589:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788625423.120590:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206269568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.120605:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206269312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625423.120625:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206269568:12345-0@lo:400:kworker.0 Request processed in 40us (3536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625423.120632:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788625423.120646:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788625423.120654:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206269184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.120661:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206269312:12345-0@lo:400:kworker.0 Request processed in 59us (2913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625423.120670:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788625423.120688:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875509206269184:12345-0@lo:400:kworker.0 Request processed in 35us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625423.120696:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788625423.121296:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788625423.121348:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206269440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625423.121395:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206269696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625423.121403:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206269440:12345-0@lo:400:kworker.0 Request processed in 698us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625423.121411:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788625423.121438:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625423.121542:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875509206269184:0@lo:400:kworker.0 00010000:00080000:2.0:1788625423.121636:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998872d27480 x1875509206269312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625423.121651:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206269312:0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.121716:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987441fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206269824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625423.123431:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206268160 00000100:00100000:1.0:1788625423.123444:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206268160 00000100:00100000:1.0:1788625423.123496:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788625423.123505:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3638:x1875509206268160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625423.126430:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206269696 00000100:00100000:0.0:1788625423.126446:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206269696 00000100:00100000:0.0:1788625423.126500:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788625423.126538:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1875509206268032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625423.126584:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788625423.127152:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3638:x1875509206268160:12345-0@lo:400:kworker.0 Request processed in 3644us (7740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625423.127163:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788625423.127958:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206269440:0@lo:400:kworker.0 00000100:00100000:1.0:1788625423.127993:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206268544:0@lo:400:kworker.0 00000100:00100000:1.0:1788625423.128009:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206269056:0@lo:400:kworker.0 00010000:00080000:1.0:1788625423.128024:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998872d24a80 x1875509206269568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625423.128035:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206269568:0@lo:400:kworker.0 00000100:00100000:1.0:1788625423.128100:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206268416:0@lo:400:kworker.0 00000100:00100000:1.0:1788625423.128113:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206268928:0@lo:400:kworker.0 00000100:00100000:0.0:1788625423.129436:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1875509206268032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2892us (13600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625423.129450:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788625423.129484:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788625423.129497:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206269696:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625423.130147:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625423.130200:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3638:1875509206268160:0@lo:400:kworker.0 00000100:00100000:2.0:1788625423.130248:0:18749:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788625423.130258:0:18749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1788625423.131170:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788625423.131321:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206269696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1827us (9882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625423.131330:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788625423.131352:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206269824 00000100:00100000:0.0:1788625423.131359:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206269824 00000100:00100000:0.0:1788625423.131389:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788625423.131396:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206269824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788625423.131405:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788625423.131575:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206269696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625423.131646:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206268032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625423.133147:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206269824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1744us (2995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625423.133158:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788625423.136753:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987441fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206269824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625423.362710:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625423.362759:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625423.362815:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185229440 00000100:00100000:1.0:1788625423.362826:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185229440 00002000:00100000:1.0:1788625423.362890:0:18750:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff998872d0c380 x1875509185229440/t0(0) o4->2577c14b-df6c-4b8f-a20a-0ae385000d2e@192.168.204.14@tcp:234/0 lens 504/0 e 0 to 0 dl 1788625434 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788625423.362902:0:18750:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998872d0c380 with x1875509185229440 ext(0->8) 00002000:00010000:1.0:1788625423.362908:0:18750:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff998872d0c380 00000100:00100000:1.0:1788625423.362937:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:1.0:1788625423.362947:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+8:2391:x1875509185229440:12345-192.168.204.14@tcp:4:bash.0 00000100:00080000:1.0:1788625423.363565:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625423.363726:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185229568 00000100:00100000:3.0:1788625423.363733:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185229568 00000100:00100000:3.0:1788625423.363779:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 28 00000100:00100000:3.0:1788625423.363789:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+11:2391:x1875509185229568:12345-192.168.204.14@tcp:16:kworker.0 00000100:00100000:3.0:1788625423.364610:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+11:2391:x1875509185229440:12345-192.168.204.14@tcp:4:bash.0 Request processed in 1659us (1845us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788625423.364625:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 0 00002000:00100000:3.0:1788625423.364636:0:18750:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff998872d0c380 x1875509185229440/t8589934599(0) o4->2577c14b-df6c-4b8f-a20a-0ae385000d2e@192.168.204.14@tcp:234/0 lens 504/448 e 0 to 0 dl 1788625434 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788625423.364647:0:18750:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998872d0c380 with x1875509185229440 ext(0->8) 00002000:00010000:3.0:1788625423.364652:0:18750:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff998872d0c380 00000001:00080000:1.0:1788625423.368202:0:19558:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1788625423.368222:0:19558:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:2.0:1788625423.368488:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2391:x1875509185229568:12345-192.168.204.14@tcp:16:kworker.0 Request processed in 4693us (5782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625423.368500:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 28 00010000:00010000:3.0:1788625423.756697:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42469 lines, 42469 kept, 0 dropped, 0 bad.